check-the-ingestion-status.html 1.2 KB

12345678910111213141516171819202122
  1. When a new source is created, Materialize performs a sync of all data available
  2. in the upstream Kafka topic before it starts ingesting new data — an operation
  3. known as _snapshotting_. Because the initial snapshot is persisted in the
  4. storage layer atomically (i.e., at the same ingestion timestamp), you
  5. will **not able to query the source until snapshotting is complete**.
  6. In this step, you'll monitor the progress of the initial snapshot using the
  7. observability features in the [Materialize Console](/console/).
  8. 1. If not already logged in, [log in to the Materialize Console](https://console.materialize.com/).
  9. 1. Navigate to **Monitoring** > **Sources** and click through to the source you
  10. created in the previous step. In the source overview page, you will see a
  11. progress bar with the status and progress of the snapshot.
  12. 1. For the duration of the snapshotting operation, the source status will show
  13. as `Snapshotting`. Once the source status transitions from `Snapshotting` to
  14. `Running`, the source is ready for querying and you can move on to the next
  15. step.
  16. If the source fails to transition to this state, check the
  17. [ingestion troubleshooting guide](/ingest-data/troubleshooting/).