Add dynamic content info #25419
Open
Add dynamic content info #25419
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This pull request requires reviews from CODEOWNERS as it changes files that match the following patterns:
|
simonabadoiu
requested review from
ToriLindsay,
celso,
kathayl and
mchenco
as code owners
haleycode
assigned
ToriLindsay and unassigned
pedrosousa,
dcpena,
haleycode and
patriciasantaana
ToriLindsay
requested changes
Oct 8, 2025
| @@ -0,0 +1,11 @@ | |||
| ### Single Page Applications (SPAs) | |||
There was a problem hiding this comment.
Suggested change
| ### Single Page Applications (SPAs) | |
| ## Scrape a Single Page Applications (SPAs) |
| @@ -0,0 +1,11 @@ | |||
| ### Single Page Applications (SPAs) | |||
|
|
|||
| When scraping a Single Page Application (SPA) with dynamic content, you must ensure the page has fully loaded. To do this, you have two main options: | |||
There was a problem hiding this comment.
Suggested change
| When scraping a Single Page Application (SPA) with dynamic content, you must ensure the page has fully loaded. To do this, you have two main options: | |
| To scrape a Single Page Application (SPA) with dynamic content, make sure the page has fully loaded using one of these methods: |
| ### Single Page Applications (SPAs) | ||
|
|
||
| When scraping a Single Page Application (SPA) with dynamic content, you must ensure the page has fully loaded. To do this, you have two main options: | ||
|
|
There was a problem hiding this comment.
Suggested change
| - Recommended: Use `waitForSelector` to wait for a specific element to appear on the page. | |
| - Use `goToOptions` with `networkidle0` or `networkidle2`. Between the `networkidle` options, `networkidle2` is more efficient because it waits until there are less than two ongoing network connections, whereas `networkidle0` waits until all network connections are idle and all resources (including asynchronous JavaScript) have loaded. | |
|
|
||
| When scraping a Single Page Application (SPA) with dynamic content, you must ensure the page has fully loaded. To do this, you have two main options: | ||
|
|
||
| :::note |
There was a problem hiding this comment.
Suggested change
| :::note |
| When scraping a Single Page Application (SPA) with dynamic content, you must ensure the page has fully loaded. To do this, you have two main options: | ||
|
|
||
| :::note | ||
| Use `waitForSelector` to wait for a specific element to appear on the page. This is often the most reliable and efficient method. |
There was a problem hiding this comment.
Suggested change
| Use `waitForSelector` to wait for a specific element to appear on the page. This is often the most reliable and efficient method. |
|
|
||
| :::note | ||
| Use `waitForSelector` to wait for a specific element to appear on the page. This is often the most reliable and efficient method. | ||
|
|
| :::note | ||
| Use `waitForSelector` to wait for a specific element to appear on the page. This is often the most reliable and efficient method. | ||
|
|
||
| Use `goToOptions` with `"networkidle0"` or `"networkidle2"` |
There was a problem hiding this comment.
Suggested change
| Use `goToOptions` with `"networkidle0"` or `"networkidle2"` |
| Use `waitForSelector` to wait for a specific element to appear on the page. This is often the most reliable and efficient method. | ||
|
|
||
| Use `goToOptions` with `"networkidle0"` or `"networkidle2"` | ||
| - `"networkidle0"` waits for all network connections to be idle, meaning all resources (including asynchronous JavaScript) have been loaded |
There was a problem hiding this comment.
Suggested change
| - `"networkidle0"` waits for all network connections to be idle, meaning all resources (including asynchronous JavaScript) have been loaded |
|
|
||
| Use `goToOptions` with `"networkidle0"` or `"networkidle2"` | ||
| - `"networkidle0"` waits for all network connections to be idle, meaning all resources (including asynchronous JavaScript) have been loaded | ||
| - `"networkidle2"` is a more efficient alternative that waits until there are only two or fewer ongoing network connections |
There was a problem hiding this comment.
Suggested change
| - `"networkidle2"` is a more efficient alternative that waits until there are only two or fewer ongoing network connections |
| Use `goToOptions` with `"networkidle0"` or `"networkidle2"` | ||
| - `"networkidle0"` waits for all network connections to be idle, meaning all resources (including asynchronous JavaScript) have been loaded | ||
| - `"networkidle2"` is a more efficient alternative that waits until there are only two or fewer ongoing network connections | ||
| ::: |
|
@simonabadoiu Sorry for the delay. This didn't auto-assign to me when you submitted it for some reason so I just saw it. Left you some suggestions. Let me know when you're done and I'll approve. Thanks! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Screenshots (optional)
Documentation checklist