Monitoring basics

What is a monitor?

A monitor is a rule that specifies a webpage to watch, what to extract from the page, an optional data transformation and the webhook to notify when the data changes.

It runs at a given frequency, determined by the plan you subscribed to. Every time, it will load the webpage in a web browser, wait for the selectors you specified to be present, and then extract their contents.

This content is then fed to a transformation (if you specify one), and the result is sent to the webhook in a POST request.

If you didn't specify a transformation, the data that was originally extracted from the web page will be sent to the webhook instead.

Monitoring frequency

Monitors are scheduled to run on a frequency determined by your plan. They will execute every 4 hours in the Free plan, to every minute on the "1 min" plan.

On the free plan, more specifically, it will be executed in the following hours:

  • 12:00 PM

  • 4:00 AM

  • 8:00 AM

  • 12:00 PM

  • 4:00 PM

  • 8:00 PM

For the hourly plan (every 1 hour), the monitor will be executed every hour at 00 minutes. 12:00, 1:00, 2:00 etc.

The same applies for the remaining plans. "10 minutes" will execute every 10 minutes the entire day, 12:00, 12:10, 12:20, 12:30 etc. and the "1 minute" plan will execute every single minute.

Higher frequencies are possible depending on the eligibility of the use case. Please get in touch with us in this case.

When is a monitor executed for the first time?

The monitor will always be executed on its schedule. After its creation, it will wait for the next cycle to execute for the first time.

See the section above for details on monitor schedules.

What happens when a monitor fails?

Monitors that fail will show an error indicator, both in your list of monitors and on the individual monitor page.

When you open the Monitor's page you will be able to see which error happened and at which stage.

You can fix it interactively by editing it, extracting data, inspecting the output and then triggering your webhook.

If you make changes to the monitor, they will be picked up on the next run, and then the error will disappear if the monitor was executed successfully.

Are disabled monitors counting against my plan?

No, only enabled monitors are counted against your limit. You can have as many disabled monitors as you want.

Any potential abuse will be investigated with the account owner and potentially lead to account suspension.