Skip to content

Issue 327 Resolved #372

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 12, 2024
Merged

Conversation

supercoder-dev
Copy link
Contributor

To resolve the issue, we need to ensure that the 'headless' flag is correctly passed and utilized in the FetchNode configuration. Additionally, adding logging statements will help verify that the HTML content is being fetched correctly.
To resolve the issue, we need to add logging to capture the HTML content before parsing, add a fallback mechanism to handle cases where the body tag is not found, and modify the ValueError message to include the HTML content for debugging purposes.
To resolve the issue, we need to add logging to verify the HTML content fetched, ensure the headless flag is correctly passed to ChromiumLoader, add error handling to check if the HTML content is empty before passing it to cleanup_html, and modify the cleanup_html function call to handle cases where the HTML content might be empty.

@PeriniM PeriniM changed the base branch from main to pre/beta June 12, 2024 09:16
@VinciGit00 VinciGit00 merged commit 0145b8f into ScrapeGraphAI:pre/beta Jun 12, 2024
Copy link

🎉 This PR is included in version 1.7.0-beta.5 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants