Managing Project Errors
When you deploy to Rill Cloud, projects can encounter errors—from missing credentials to data type mismatches. This guide focuses on managing errors in deployed projects and setting up automated alerts.
For general troubleshooting guidance, error message explanations, and debugging techniques, see the Debugging Rill Projects documentation.
How Rill Handles Errors
Rill's error management approach ensures visibility and isolation:
- Visibility: View project status at the resource level via the
Statustab orrill project statusCLI command - Isolation: Errors are contained to individual resource trees—if one dashboard fails, others remain available
- Fallback: Rill attempts to serve from the most recent valid state when possible
The surfaced error might not be the root cause. A dashboard error could stem from an underlying model timeout. Always check the project status page to trace errors to their source.
Deployment-Specific Error Scenarios
Most errors will surface during local development in Rill Developer. However, after deploying to Rill Cloud, you may encounter additional issues:
- Production configuration missing - Your YAML files reference
prod:parameters that have been defined incorrectly. Verify your dev/prod setup. - Timeouts, OOM - Production data volumes may be larger than local development data, leading to timeouts and out-of-memory issues. Contact us if you see any related error messages.
To troubleshoot deployment errors:
- Check the resource status in the project status page
- Review project logs using
rill project logsor the Rill Cloud UI - Compare with local behavior - If it worked locally, check production-specific configuration differences
Setting Up Error Alerts
You can configure alerts to automatically notify you when project errors occur. Once set up, you'll receive notifications (via email or Slack) whenever any resource in your project enters an error state.
Besides alerting on project errors, it is possible to configure generic alerts in your dashboards based on specific thresholds or conditions being met. For more details, check out our alerts documentation!
Configure an email alert
To configure an email alert for project errors, add a file named project_errors.yaml to your Rill project with the contents below. Remember to update the recipients field to your desired alert recipients.
type: alert
# Check the alert every 10 minutes.
refresh:
cron: "*/10 * * * *"
# Query for all resources with a reconcile error.
# The alert will trigger when the query result is not empty.
data:
resource_status:
where_error: true
# Send notifications by email
notify:
email:
recipients: [john@example.com]
This will give you a good idea of what object has an issue, and you can browse the status page for more information.
After making these changes, you should commit and push these changes to your git repository.
Configure a Slack alert
To configure a Slack alert for project errors, first follow the Slack configuration steps described on Configuring Slack integration. Next, add a file named project_errors.yaml to your Rill project with the contents below. Remember to update the channels field to your desired destination channel.
type: alert
# Check the alert every 10 minutes.
refresh:
cron: "*/10 * * * *"
# Query for all resources with a reconcile error.
# The alert will trigger when the query result is not empty.
data:
resource_status:
where_error: true
# Send notifications in Slack.
# Follow these steps to configure a Slack token: https://docs.rilldata.com/explore/alerts/slack.
notify:
slack:
channels: [rill-alerts]
After making these changes, you should commit and push these changes to your git repository or update your Rill project via the Deploy button.