From 70a883fa3293742b7b4d6f2eb94ff92a471da2fd Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 07:34:53 +0000 Subject: [PATCH 01/13] ci(release): 1.26.0 [skip ci] ## [1.26.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.25.2...v1.26.0) (2024-10-13) ### Features * add deep scraper implementation ([4b371f4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4b371f4d94dae47986aad751508813d89ce87b93)) * add google proxy support ([a986523](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a9865238847e2edccde579ace7ba226f7012e95d)) * add html_mode to smart_scraper ([bdcffd6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/bdcffd6360237b27797546a198ceece55ce4bc81)) * add reasoning integration ([b2822f6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/b2822f620a610e61d295cbf4b670aa08fde9de24)) * async invocation ([257f393](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/257f393761e8ff823e37c72659c8b55925c4aecb)) * conditional_node ([f837dc1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f837dc16ce6db0f38fd181822748ca413b7ab4b0)) * finished basic version of deep scraper ([85cb957](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/85cb9572971719f9f7c66171f5e2246376b6aed2)) * prompt refactoring ([5a2f6d9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5a2f6d9a77a814d5c3756e85cabde8af978f4c06)) * refactoring fetch_node ([39a029e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/39a029ed9a8cd7c2277ba1386b976738e99d231b)) * refactoring of mdscraper ([3b7b701](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/3b7b701a89aad503dea771db3f043167f7203d46)) * refactoring of research web ([26f89d8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/26f89d895d547ef2463492f82da7ac21b57b9d1b)) * refactoring of the conditional node ([420c71b](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/420c71ba2ca0fc77465dd533a807b887c6a87f52)) * undected_chromedriver support ([80ece21](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/80ece2179ac47a7ea42fbae4b61504a49ca18daa)) * update chromium loader ([4f816f3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4f816f3b04974e90ca4208158f05724cfe68ffb8)) ### Bug Fixes * bugs ([026a70b](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/026a70bd3a01b0ebab4d175ae4005e7f3ba3a833)) * import error ([37b6ba0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/37b6ba08ae9972240fc00a15efe43233fd093f3b)) * integration with html_mode ([f87ffa1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f87ffa1d8db32b38c47d9f5aa2ae88f1d7978a04)) * nodes prompt ([8753537](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/8753537ecd2a0ba480cda482b6dc50c090b418d6)) * pyproject.toml ([3b27c5e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/3b27c5e88c0b0744438e8b604f40929e22d722bc)) * refactoring prompts ([c655642](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c65564257798a5ccdc2bdf92487cd9b069e6d951)) * removed pdf_scraper graph and created document scraper ([a57da96](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a57da96175a09a16d990eeee679988d10832ce13)) * search_on_web paremter ([7f03ec1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/7f03ec15de20fc2d6c2aad2655cc5348cced1951)) * typo ([e285127](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/e28512720c3d47917814cf388912aef0e2230188)) ### Perf * Proxy integration in googlesearch ([e828c70](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/e828c7010acb1bd04498e027da69f35d53a37890)) ### CI * **release:** 1.22.0-beta.4 [skip ci] ([4330179](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4330179cb65674d65423c1763f90182e85c15a74)) * **release:** 1.22.0-beta.5 [skip ci] ([6d8f543](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/6d8f5435d1ecd2d90b06aade50abc064f75c9d78)) * **release:** 1.22.0-beta.6 [skip ci] ([39f7815](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/39f78154a6f1123fa8aca5e169c803111c175473)) * **release:** 1.26.0-beta.1 [skip ci] ([ac31d7f](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ac31d7f7101ba6d7251131aa010d9ef948fa611f)) * **release:** 1.26.0-beta.10 [skip ci] ([0c7ebe2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/0c7ebe28ac32abeab9b55bca2bceb7c4e591028e)) * **release:** 1.26.0-beta.11 [skip ci] ([6d8828a](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/6d8828aa62a8026cc874d84169a5bcb600b1a389)) * **release:** 1.26.0-beta.12 [skip ci] ([44d10aa](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/44d10aa1c035efe5b71d4394e702ff2592eac18d)) * **release:** 1.26.0-beta.13 [skip ci] ([12f2b99](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/12f2b9946be0b68b59a25cbd71f675ac705198cc)) * **release:** 1.26.0-beta.14 [skip ci] ([eb25725](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/eb257259f8880466bf9a01416e0c9366d3d55a3b)) * **release:** 1.26.0-beta.15 [skip ci] ([528a974](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/528a9746fed50c1ca1c1a572951d6a7044bf85fc)) * **release:** 1.26.0-beta.16 [skip ci] ([04bd2a8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/04bd2a87fbd482c92cf35398127835205d8191f0)) * **release:** 1.26.0-beta.17 [skip ci] ([f17089c](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f17089c123d96ae9e1407e2c008209dc630b45da)) * **release:** 1.26.0-beta.2 [skip ci] ([5cedeb8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5cedeb8486f5ca30586876be0c26f81b43ce8031)) * **release:** 1.26.0-beta.3 [skip ci] ([4f65be4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4f65be44b50b314a96bb746830070e79095b713c)) * **release:** 1.26.0-beta.4 [skip ci] ([84d7937](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/84d7937472513d140d1a2334f974a571cbf42a45)) * **release:** 1.26.0-beta.5 [skip ci] ([ea9ed1a](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ea9ed1a9819f1c931297743fb69ee4ee1bf6665a)) * **release:** 1.26.0-beta.6 [skip ci] ([4cd21f5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4cd21f500d545852a7a17328586a45306eac7419)) * **release:** 1.26.0-beta.7 [skip ci] ([482f060](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/482f060c9ad2a0fd203a4e47ac7103bf8040550d)) * **release:** 1.26.0-beta.8 [skip ci] ([38b795e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/38b795e48a1e568a823571a3c2f9fdeb95d0266e)) * **release:** 1.26.0-beta.9 [skip ci] ([4dc0699](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4dc06994832c561eeebca172c965a42aee661f3e)) --- CHANGELOG.md | 62 ++++++++++++++++++++++++++++++++++++++++++++++++++ pyproject.toml | 2 +- 2 files changed, 63 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index f5f3eeab..b719712e 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,65 @@ +## [1.26.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.25.2...v1.26.0) (2024-10-13) + + +### Features + +* add deep scraper implementation ([4b371f4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4b371f4d94dae47986aad751508813d89ce87b93)) +* add google proxy support ([a986523](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a9865238847e2edccde579ace7ba226f7012e95d)) +* add html_mode to smart_scraper ([bdcffd6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/bdcffd6360237b27797546a198ceece55ce4bc81)) +* add reasoning integration ([b2822f6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/b2822f620a610e61d295cbf4b670aa08fde9de24)) +* async invocation ([257f393](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/257f393761e8ff823e37c72659c8b55925c4aecb)) +* conditional_node ([f837dc1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f837dc16ce6db0f38fd181822748ca413b7ab4b0)) +* finished basic version of deep scraper ([85cb957](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/85cb9572971719f9f7c66171f5e2246376b6aed2)) +* prompt refactoring ([5a2f6d9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5a2f6d9a77a814d5c3756e85cabde8af978f4c06)) +* refactoring fetch_node ([39a029e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/39a029ed9a8cd7c2277ba1386b976738e99d231b)) +* refactoring of mdscraper ([3b7b701](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/3b7b701a89aad503dea771db3f043167f7203d46)) +* refactoring of research web ([26f89d8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/26f89d895d547ef2463492f82da7ac21b57b9d1b)) +* refactoring of the conditional node ([420c71b](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/420c71ba2ca0fc77465dd533a807b887c6a87f52)) +* undected_chromedriver support ([80ece21](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/80ece2179ac47a7ea42fbae4b61504a49ca18daa)) +* update chromium loader ([4f816f3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4f816f3b04974e90ca4208158f05724cfe68ffb8)) + + +### Bug Fixes + +* bugs ([026a70b](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/026a70bd3a01b0ebab4d175ae4005e7f3ba3a833)) +* import error ([37b6ba0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/37b6ba08ae9972240fc00a15efe43233fd093f3b)) +* integration with html_mode ([f87ffa1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f87ffa1d8db32b38c47d9f5aa2ae88f1d7978a04)) +* nodes prompt ([8753537](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/8753537ecd2a0ba480cda482b6dc50c090b418d6)) +* pyproject.toml ([3b27c5e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/3b27c5e88c0b0744438e8b604f40929e22d722bc)) +* refactoring prompts ([c655642](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c65564257798a5ccdc2bdf92487cd9b069e6d951)) +* removed pdf_scraper graph and created document scraper ([a57da96](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a57da96175a09a16d990eeee679988d10832ce13)) +* search_on_web paremter ([7f03ec1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/7f03ec15de20fc2d6c2aad2655cc5348cced1951)) +* typo ([e285127](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/e28512720c3d47917814cf388912aef0e2230188)) + + +### Perf + +* Proxy integration in googlesearch ([e828c70](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/e828c7010acb1bd04498e027da69f35d53a37890)) + + +### CI + +* **release:** 1.22.0-beta.4 [skip ci] ([4330179](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4330179cb65674d65423c1763f90182e85c15a74)) +* **release:** 1.22.0-beta.5 [skip ci] ([6d8f543](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/6d8f5435d1ecd2d90b06aade50abc064f75c9d78)) +* **release:** 1.22.0-beta.6 [skip ci] ([39f7815](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/39f78154a6f1123fa8aca5e169c803111c175473)) +* **release:** 1.26.0-beta.1 [skip ci] ([ac31d7f](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ac31d7f7101ba6d7251131aa010d9ef948fa611f)) +* **release:** 1.26.0-beta.10 [skip ci] ([0c7ebe2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/0c7ebe28ac32abeab9b55bca2bceb7c4e591028e)) +* **release:** 1.26.0-beta.11 [skip ci] ([6d8828a](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/6d8828aa62a8026cc874d84169a5bcb600b1a389)) +* **release:** 1.26.0-beta.12 [skip ci] ([44d10aa](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/44d10aa1c035efe5b71d4394e702ff2592eac18d)) +* **release:** 1.26.0-beta.13 [skip ci] ([12f2b99](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/12f2b9946be0b68b59a25cbd71f675ac705198cc)) +* **release:** 1.26.0-beta.14 [skip ci] ([eb25725](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/eb257259f8880466bf9a01416e0c9366d3d55a3b)) +* **release:** 1.26.0-beta.15 [skip ci] ([528a974](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/528a9746fed50c1ca1c1a572951d6a7044bf85fc)) +* **release:** 1.26.0-beta.16 [skip ci] ([04bd2a8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/04bd2a87fbd482c92cf35398127835205d8191f0)) +* **release:** 1.26.0-beta.17 [skip ci] ([f17089c](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f17089c123d96ae9e1407e2c008209dc630b45da)) +* **release:** 1.26.0-beta.2 [skip ci] ([5cedeb8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5cedeb8486f5ca30586876be0c26f81b43ce8031)) +* **release:** 1.26.0-beta.3 [skip ci] ([4f65be4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4f65be44b50b314a96bb746830070e79095b713c)) +* **release:** 1.26.0-beta.4 [skip ci] ([84d7937](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/84d7937472513d140d1a2334f974a571cbf42a45)) +* **release:** 1.26.0-beta.5 [skip ci] ([ea9ed1a](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ea9ed1a9819f1c931297743fb69ee4ee1bf6665a)) +* **release:** 1.26.0-beta.6 [skip ci] ([4cd21f5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4cd21f500d545852a7a17328586a45306eac7419)) +* **release:** 1.26.0-beta.7 [skip ci] ([482f060](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/482f060c9ad2a0fd203a4e47ac7103bf8040550d)) +* **release:** 1.26.0-beta.8 [skip ci] ([38b795e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/38b795e48a1e568a823571a3c2f9fdeb95d0266e)) +* **release:** 1.26.0-beta.9 [skip ci] ([4dc0699](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4dc06994832c561eeebca172c965a42aee661f3e)) + ## [1.26.0-beta.17](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0-beta.16...v1.26.0-beta.17) (2024-10-12) diff --git a/pyproject.toml b/pyproject.toml index a2e18bd0..dd8523c3 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.0b17" +version = "1.26.0" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [ From 7b073686ef1ff743defae5a2af3e740650f658d2 Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:07:40 +0200 Subject: [PATCH 02/13] fix: async tim --- pyproject.toml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/pyproject.toml b/pyproject.toml index f6033f60..e486e58d 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -34,6 +34,9 @@ dependencies = [ "fastembed>=0.3.6" "semchunk>=2.2.0", "transformers>=4.44.2" + "transformers>=4.44.2", + "googlesearch-python>=1.2.5", + "async-timeout>=4.0.3" ] license = "MIT" From c9d6ef5915b2155379fba5132c8640635eb7da06 Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:09:04 +0200 Subject: [PATCH 03/13] fix: typo --- pyproject.toml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pyproject.toml b/pyproject.toml index d0d5d599..6d1187b1 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -35,7 +35,7 @@ dependencies = [ "transformers>=4.44.2" "transformers>=4.44.2", "googlesearch-python>=1.2.5", - "async-timeout>=4.0.3" + "async-timeout>=4.0.3", "transformers>=4.44.2", "googlesearch-python>=1.2.5" ] From 9c62f24e7396c298f16470bac9f548e8fe51ca5f Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:10:56 +0200 Subject: [PATCH 04/13] fix: typo --- pyproject.toml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pyproject.toml b/pyproject.toml index 6d1187b1..24cffbfa 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -32,7 +32,7 @@ dependencies = [ "qdrant-client>=1.11.3", "fastembed>=0.3.6", "semchunk>=2.2.0", - "transformers>=4.44.2" + "transformers>=4.44.2", "transformers>=4.44.2", "googlesearch-python>=1.2.5", "async-timeout>=4.0.3", From cd36c2a0f3aa0d5655b9a51c1c5b9b6d3c5ccf89 Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 08:12:23 +0000 Subject: [PATCH 05/13] ci(release): 1.26.1 [skip ci] ## [1.26.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0...v1.26.1) (2024-10-13) ### Bug Fixes * async tim ([7b07368](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/7b073686ef1ff743defae5a2af3e740650f658d2)) * typo ([9c62f24](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/9c62f24e7396c298f16470bac9f548e8fe51ca5f)) * typo ([c9d6ef5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c9d6ef5915b2155379fba5132c8640635eb7da06)) --- CHANGELOG.md | 9 +++++++++ pyproject.toml | 2 +- 2 files changed, 10 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index b719712e..2deb713f 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,12 @@ +## [1.26.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0...v1.26.1) (2024-10-13) + + +### Bug Fixes + +* async tim ([7b07368](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/7b073686ef1ff743defae5a2af3e740650f658d2)) +* typo ([9c62f24](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/9c62f24e7396c298f16470bac9f548e8fe51ca5f)) +* typo ([c9d6ef5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c9d6ef5915b2155379fba5132c8640635eb7da06)) + ## [1.26.0](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.25.2...v1.26.0) (2024-10-13) diff --git a/pyproject.toml b/pyproject.toml index 24cffbfa..cf726f6a 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.0" +version = "1.26.1" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [ From 35c44e4d2ca3f6f7f27c8c5efd3381e8fc3acc82 Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:17:03 +0200 Subject: [PATCH 06/13] fix: add new dipendency --- pyproject.toml | 3 ++- requirements-dev.lock | 8 +++++--- requirements.lock | 8 +++++--- 3 files changed, 12 insertions(+), 7 deletions(-) diff --git a/pyproject.toml b/pyproject.toml index 24cffbfa..00143e98 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -37,7 +37,8 @@ dependencies = [ "googlesearch-python>=1.2.5", "async-timeout>=4.0.3", "transformers>=4.44.2", - "googlesearch-python>=1.2.5" + "googlesearch-python>=1.2.5", + "simpleeval>=1.0.0" ] license = "MIT" diff --git a/requirements-dev.lock b/requirements-dev.lock index b33667db..bca5e9c2 100644 --- a/requirements-dev.lock +++ b/requirements-dev.lock @@ -32,6 +32,7 @@ astroid==3.2.4 async-timeout==4.0.3 # via aiohttp # via langchain + # via scrapegraphai attrs==24.2.0 # via aiohttp # via jsonschema @@ -40,7 +41,7 @@ babel==2.16.0 # via sphinx beautifulsoup4==4.12.3 # via furo - # via google + # via googlesearch-python # via scrapegraphai blinker==1.8.2 # via streamlit @@ -108,8 +109,6 @@ gitdb==4.0.11 # via gitpython gitpython==3.1.43 # via streamlit -google==3.0.0 - # via scrapegraphai google-ai-generativelanguage==0.6.6 # via google-generativeai google-api-core==2.19.1 @@ -131,6 +130,8 @@ google-generativeai==0.7.2 googleapis-common-protos==1.63.2 # via google-api-core # via grpcio-status +googlesearch-python==1.2.5 + # via scrapegraphai graphviz==0.20.3 # via burr greenlet==3.0.3 @@ -417,6 +418,7 @@ requests==2.32.3 # via fastembed # via free-proxy # via google-api-core + # via googlesearch-python # via huggingface-hub # via langchain # via langchain-community diff --git a/requirements.lock b/requirements.lock index 8b2b7244..38be6e68 100644 --- a/requirements.lock +++ b/requirements.lock @@ -21,12 +21,13 @@ anyio==4.4.0 async-timeout==4.0.3 # via aiohttp # via langchain + # via scrapegraphai attrs==23.2.0 # via aiohttp # via jsonschema # via referencing beautifulsoup4==4.12.3 - # via google + # via googlesearch-python # via scrapegraphai boto3==1.34.146 # via langchain-aws @@ -65,8 +66,6 @@ frozenlist==1.4.1 # via aiosignal fsspec==2024.6.1 # via huggingface-hub -google==3.0.0 - # via scrapegraphai google-ai-generativelanguage==0.6.6 # via google-generativeai google-api-core==2.19.1 @@ -88,6 +87,8 @@ google-generativeai==0.7.2 googleapis-common-protos==1.63.2 # via google-api-core # via grpcio-status +googlesearch-python==1.2.5 + # via scrapegraphai greenlet==3.0.3 # via playwright grpcio==1.65.1 @@ -306,6 +307,7 @@ requests==2.32.3 # via fastembed # via free-proxy # via google-api-core + # via googlesearch-python # via huggingface-hub # via langchain # via langchain-community From 673241a9ca3fb4ba730c26249894f322bbd0797f Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 08:18:57 +0000 Subject: [PATCH 07/13] ci(release): 1.26.2 [skip ci] ## [1.26.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.1...v1.26.2) (2024-10-13) ### Bug Fixes * add new dipendency ([35c44e4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/35c44e4d2ca3f6f7f27c8c5efd3381e8fc3acc82)) --- CHANGELOG.md | 7 +++++++ pyproject.toml | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 2deb713f..66948a53 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,10 @@ +## [1.26.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.1...v1.26.2) (2024-10-13) + + +### Bug Fixes + +* add new dipendency ([35c44e4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/35c44e4d2ca3f6f7f27c8c5efd3381e8fc3acc82)) + ## [1.26.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.0...v1.26.1) (2024-10-13) diff --git a/pyproject.toml b/pyproject.toml index 20d5b025..afa5daff 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.1" +version = "1.26.2" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [ From 431b2093bee2ef5eea8292e804044b06c73585d7 Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:25:36 +0200 Subject: [PATCH 08/13] fix: generate answer node --- scrapegraphai/nodes/generate_answer_node.py | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/scrapegraphai/nodes/generate_answer_node.py b/scrapegraphai/nodes/generate_answer_node.py index 384d811d..40f7182d 100644 --- a/scrapegraphai/nodes/generate_answer_node.py +++ b/scrapegraphai/nodes/generate_answer_node.py @@ -57,7 +57,7 @@ def __init__( self.is_md_scraper = node_config.get("is_md_scraper", False) self.additional_info = node_config.get("additional_info") - async def execute(self, state: dict) -> dict: + def execute(self, state: dict) -> dict: """ Executes the GenerateAnswerNode. @@ -123,7 +123,7 @@ async def execute(self, state: dict) -> dict: chain = prompt | self.llm_model if output_parser: chain = chain | output_parser - answer = await chain.ainvoke({"question": user_prompt}) + answer = chain.invoke({"question": user_prompt}) state.update({self.output[0]: answer}) return state @@ -143,7 +143,7 @@ async def execute(self, state: dict) -> dict: chains_dict[chain_name] = chains_dict[chain_name] | output_parser async_runner = RunnableParallel(**chains_dict) - batch_results = await async_runner.ainvoke({"question": user_prompt}) + batch_results = async_runner.invoke({"question": user_prompt}) merge_prompt = PromptTemplate( template=template_merge_prompt, @@ -154,7 +154,7 @@ async def execute(self, state: dict) -> dict: merge_chain = merge_prompt | self.llm_model if output_parser: merge_chain = merge_chain | output_parser - answer = await merge_chain.ainvoke({"context": batch_results, "question": user_prompt}) + answer = merge_chain.invoke({"context": batch_results, "question": user_prompt}) state.update({self.output[0]: answer}) return state From c833d7969adde04453740853265c9dcba98c1803 Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 08:27:00 +0000 Subject: [PATCH 09/13] ci(release): 1.26.3 [skip ci] ## [1.26.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.2...v1.26.3) (2024-10-13) ### Bug Fixes * generate answer node ([431b209](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/431b2093bee2ef5eea8292e804044b06c73585d7)) --- CHANGELOG.md | 7 +++++++ pyproject.toml | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 66948a53..6d7624bf 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,10 @@ +## [1.26.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.2...v1.26.3) (2024-10-13) + + +### Bug Fixes + +* generate answer node ([431b209](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/431b2093bee2ef5eea8292e804044b06c73585d7)) + ## [1.26.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.1...v1.26.2) (2024-10-13) diff --git a/pyproject.toml b/pyproject.toml index afa5daff..d19c84ec 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.2" +version = "1.26.3" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [ From b208ef792c9347ab608fdbe0913066343c3019ff Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 10:31:12 +0200 Subject: [PATCH 10/13] fix: csv_node --- scrapegraphai/nodes/generate_answer_csv_node.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/scrapegraphai/nodes/generate_answer_csv_node.py b/scrapegraphai/nodes/generate_answer_csv_node.py index 11ab15b9..9f38c935 100644 --- a/scrapegraphai/nodes/generate_answer_csv_node.py +++ b/scrapegraphai/nodes/generate_answer_csv_node.py @@ -60,7 +60,7 @@ def __init__( self.additional_info = node_config.get("additional_info") - async def execute(self, state): + def execute(self, state): """ Generates an answer by constructing a prompt from the user's input and the scraped content, querying the language model, and parsing its response. @@ -157,7 +157,7 @@ async def execute(self, state): ) merge_chain = merge_prompt | self.llm_model | output_parser - answer = await merge_chain.ainvoke({"context": batch_results, "question": user_prompt}) + answer = merge_chain.invoke({"context": batch_results, "question": user_prompt}) state.update({self.output[0]: answer}) return state From 0e4ff09a10e36540146d93cd82ce61f0d5c59308 Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 08:34:05 +0000 Subject: [PATCH 11/13] ci(release): 1.26.4 [skip ci] ## [1.26.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.3...v1.26.4) (2024-10-13) ### Bug Fixes * csv_node ([b208ef7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/b208ef792c9347ab608fdbe0913066343c3019ff)) --- CHANGELOG.md | 7 +++++++ pyproject.toml | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 6d7624bf..184c2c36 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,10 @@ +## [1.26.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.3...v1.26.4) (2024-10-13) + + +### Bug Fixes + +* csv_node ([b208ef7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/b208ef792c9347ab608fdbe0913066343c3019ff)) + ## [1.26.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.2...v1.26.3) (2024-10-13) diff --git a/pyproject.toml b/pyproject.toml index d19c84ec..b2aedfd8 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.3" +version = "1.26.4" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [ From c2179abc60d1242f272067eaca4750019b6f1d7e Mon Sep 17 00:00:00 2001 From: Marco Vinciguerra Date: Sun, 13 Oct 2024 11:30:39 +0200 Subject: [PATCH 12/13] fix: async invocation --- scrapegraphai/builders/graph_builder.py | 2 +- scrapegraphai/nodes/generate_answer_csv_node.py | 2 +- scrapegraphai/nodes/generate_answer_node_k_level.py | 2 +- scrapegraphai/nodes/generate_answer_omni_node.py | 4 ++-- scrapegraphai/nodes/generate_code_node.py | 4 ++-- scrapegraphai/nodes/generate_scraper_node.py | 2 +- scrapegraphai/nodes/html_analyzer_node.py | 2 +- scrapegraphai/nodes/merge_answers_node.py | 2 +- scrapegraphai/nodes/merge_generated_scripts_node.py | 2 +- scrapegraphai/nodes/prompt_refiner_node.py | 2 +- scrapegraphai/nodes/reasoning_node.py | 2 +- scrapegraphai/nodes/robots_node.py | 2 +- scrapegraphai/nodes/search_link_node.py | 2 +- scrapegraphai/utils/code_error_analysis.py | 8 ++++---- scrapegraphai/utils/code_error_correction.py | 8 ++++---- 15 files changed, 23 insertions(+), 23 deletions(-) diff --git a/scrapegraphai/builders/graph_builder.py b/scrapegraphai/builders/graph_builder.py index 78cb5265..e63b040b 100644 --- a/scrapegraphai/builders/graph_builder.py +++ b/scrapegraphai/builders/graph_builder.py @@ -119,7 +119,7 @@ def build_graph(self): Returns: dict: A JSON representation of the graph configuration. """ - return self.chain.ainvoke(self.prompt) + return self.chain.invoke(self.prompt) @staticmethod def convert_json_to_graphviz(json_data, format: str = 'pdf'): diff --git a/scrapegraphai/nodes/generate_answer_csv_node.py b/scrapegraphai/nodes/generate_answer_csv_node.py index 9f38c935..0419d891 100644 --- a/scrapegraphai/nodes/generate_answer_csv_node.py +++ b/scrapegraphai/nodes/generate_answer_csv_node.py @@ -126,7 +126,7 @@ def execute(self, state): ) chain = prompt | self.llm_model | output_parser - answer = chain.ainvoke({"question": user_prompt}) + answer = chain.invoke({"question": user_prompt}) state.update({self.output[0]: answer}) return state diff --git a/scrapegraphai/nodes/generate_answer_node_k_level.py b/scrapegraphai/nodes/generate_answer_node_k_level.py index 63fbbeaa..291109f2 100644 --- a/scrapegraphai/nodes/generate_answer_node_k_level.py +++ b/scrapegraphai/nodes/generate_answer_node_k_level.py @@ -143,7 +143,7 @@ def execute(self, state: dict) -> dict: merge_chain = merge_prompt | self.llm_model if output_parser: merge_chain = merge_chain | output_parser - answer = merge_chain.ainvoke({"context": batch_results, "question": user_prompt}) + answer = merge_chain.invoke({"context": batch_results, "question": user_prompt}) state["answer"] = answer diff --git a/scrapegraphai/nodes/generate_answer_omni_node.py b/scrapegraphai/nodes/generate_answer_omni_node.py index b793f5ee..b1301c99 100644 --- a/scrapegraphai/nodes/generate_answer_omni_node.py +++ b/scrapegraphai/nodes/generate_answer_omni_node.py @@ -117,7 +117,7 @@ def execute(self, state: dict) -> dict: ) chain = prompt | self.llm_model | output_parser - answer = chain.ainvoke({"question": user_prompt}) + answer = chain.invoke({"question": user_prompt}) state.update({self.output[0]: answer}) return state @@ -149,7 +149,7 @@ def execute(self, state: dict) -> dict: ) merge_chain = merge_prompt | self.llm_model | output_parser - answer = merge_chain.ainvoke({"context": batch_results, "question": user_prompt}) + answer = merge_chain.invoke({"context": batch_results, "question": user_prompt}) state.update({self.output[0]: answer}) return state diff --git a/scrapegraphai/nodes/generate_code_node.py b/scrapegraphai/nodes/generate_code_node.py index d6f4ce7c..e5f98f70 100644 --- a/scrapegraphai/nodes/generate_code_node.py +++ b/scrapegraphai/nodes/generate_code_node.py @@ -325,7 +325,7 @@ def generate_initial_code(self, state: dict) -> str: output_parser = StrOutputParser() chain = prompt | self.llm_model | output_parser - generated_code = chain.ainvoke({}) + generated_code = chain.invoke({}) return generated_code def semantic_comparison(self, generated_result: Any, reference_result: Any) -> Dict[str, Any]: @@ -368,7 +368,7 @@ def semantic_comparison(self, generated_result: Any, reference_result: Any) -> D ) chain = prompt | self.llm_model | output_parser - return chain.ainvoke({ + return chain.invoke({ "generated_result": json.dumps(generated_result, indent=2), "reference_result": json.dumps(reference_result_dict, indent=2) }) diff --git a/scrapegraphai/nodes/generate_scraper_node.py b/scrapegraphai/nodes/generate_scraper_node.py index b144227d..8868d710 100644 --- a/scrapegraphai/nodes/generate_scraper_node.py +++ b/scrapegraphai/nodes/generate_scraper_node.py @@ -130,7 +130,7 @@ def execute(self, state: dict) -> dict: ) map_chain = prompt | self.llm_model | StrOutputParser() - answer = map_chain.ainvoke({"question": user_prompt}) + answer = map_chain.invoke({"question": user_prompt}) state.update({self.output[0]: answer}) return state diff --git a/scrapegraphai/nodes/html_analyzer_node.py b/scrapegraphai/nodes/html_analyzer_node.py index d3aa5819..26304dcd 100644 --- a/scrapegraphai/nodes/html_analyzer_node.py +++ b/scrapegraphai/nodes/html_analyzer_node.py @@ -93,7 +93,7 @@ def execute(self, state: dict) -> dict: output_parser = StrOutputParser() chain = prompt | self.llm_model | output_parser - html_analysis = chain.ainvoke({}) + html_analysis = chain.invoke({}) state.update({self.output[0]: html_analysis, self.output[1]: reduced_html}) return state diff --git a/scrapegraphai/nodes/merge_answers_node.py b/scrapegraphai/nodes/merge_answers_node.py index 8f2b9aff..9f9a356c 100644 --- a/scrapegraphai/nodes/merge_answers_node.py +++ b/scrapegraphai/nodes/merge_answers_node.py @@ -95,7 +95,7 @@ def execute(self, state: dict) -> dict: ) merge_chain = prompt_template | self.llm_model | output_parser - answer = merge_chain.ainvoke({"user_prompt": user_prompt}) + answer = merge_chain.invoke({"user_prompt": user_prompt}) answer["sources"] = state.get("urls", []) state.update({self.output[0]: answer}) diff --git a/scrapegraphai/nodes/merge_generated_scripts_node.py b/scrapegraphai/nodes/merge_generated_scripts_node.py index 9a3469f0..fad7af70 100644 --- a/scrapegraphai/nodes/merge_generated_scripts_node.py +++ b/scrapegraphai/nodes/merge_generated_scripts_node.py @@ -74,7 +74,7 @@ def execute(self, state: dict) -> dict: ) merge_chain = prompt_template | self.llm_model | StrOutputParser() - answer = merge_chain.ainvoke({"user_prompt": user_prompt}) + answer = merge_chain.invoke({"user_prompt": user_prompt}) state.update({self.output[0]: answer}) return state diff --git a/scrapegraphai/nodes/prompt_refiner_node.py b/scrapegraphai/nodes/prompt_refiner_node.py index afb86ca3..66c960ff 100644 --- a/scrapegraphai/nodes/prompt_refiner_node.py +++ b/scrapegraphai/nodes/prompt_refiner_node.py @@ -96,7 +96,7 @@ def execute(self, state: dict) -> dict: output_parser = StrOutputParser() chain = prompt | self.llm_model | output_parser - refined_prompt = chain.ainvoke({}) + refined_prompt = chain.invoke({}) state.update({self.output[0]: refined_prompt}) return state diff --git a/scrapegraphai/nodes/reasoning_node.py b/scrapegraphai/nodes/reasoning_node.py index 4a9ea290..6b91155c 100644 --- a/scrapegraphai/nodes/reasoning_node.py +++ b/scrapegraphai/nodes/reasoning_node.py @@ -91,7 +91,7 @@ def execute(self, state: dict) -> dict: output_parser = StrOutputParser() chain = prompt | self.llm_model | output_parser - refined_prompt = chain.ainvoke({}) + refined_prompt = chain.invoke({}) state.update({self.output[0]: refined_prompt}) return state diff --git a/scrapegraphai/nodes/robots_node.py b/scrapegraphai/nodes/robots_node.py index 7e7303bf..2bb47e74 100644 --- a/scrapegraphai/nodes/robots_node.py +++ b/scrapegraphai/nodes/robots_node.py @@ -108,7 +108,7 @@ def execute(self, state: dict) -> dict: ) chain = prompt | self.llm_model | output_parser - is_scrapable = chain.ainvoke({"path": source})[0] + is_scrapable = chain.invoke({"path": source})[0] if "no" in is_scrapable: self.logger.warning( diff --git a/scrapegraphai/nodes/search_link_node.py b/scrapegraphai/nodes/search_link_node.py index d3fea2dc..10907850 100644 --- a/scrapegraphai/nodes/search_link_node.py +++ b/scrapegraphai/nodes/search_link_node.py @@ -142,7 +142,7 @@ def execute(self, state: dict) -> dict: input_variables=["content", "user_prompt"], ) merge_chain = merge_prompt | self.llm_model | output_parser - answer = merge_chain.ainvoke( + answer = merge_chain.invoke( {"content": chunk.page_content} ) relevant_links += answer diff --git a/scrapegraphai/utils/code_error_analysis.py b/scrapegraphai/utils/code_error_analysis.py index b147f06e..0acc8b3e 100644 --- a/scrapegraphai/utils/code_error_analysis.py +++ b/scrapegraphai/utils/code_error_analysis.py @@ -33,7 +33,7 @@ def syntax_focused_analysis(state: dict, llm_model) -> str: prompt = PromptTemplate(template=TEMPLATE_SYNTAX_ANALYSIS, input_variables=["generated_code", "errors"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "generated_code": state["generated_code"], "errors": state["errors"]["syntax"] }) @@ -53,7 +53,7 @@ def execution_focused_analysis(state: dict, llm_model) -> str: input_variables=["generated_code", "errors", "html_code", "html_analysis"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "generated_code": state["generated_code"], "errors": state["errors"]["execution"], "html_code": state["html_code"], @@ -76,7 +76,7 @@ def validation_focused_analysis(state: dict, llm_model) -> str: input_variables=["generated_code", "errors", "json_schema", "execution_result"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "generated_code": state["generated_code"], "errors": state["errors"]["validation"], "json_schema": state["json_schema"], @@ -100,7 +100,7 @@ def semantic_focused_analysis(state: dict, comparison_result: Dict[str, Any], ll input_variables=["generated_code", "differences", "explanation"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "generated_code": state["generated_code"], "differences": json.dumps(comparison_result["differences"], indent=2), "explanation": comparison_result["explanation"] diff --git a/scrapegraphai/utils/code_error_correction.py b/scrapegraphai/utils/code_error_correction.py index 038b0de9..a5119b24 100644 --- a/scrapegraphai/utils/code_error_correction.py +++ b/scrapegraphai/utils/code_error_correction.py @@ -32,7 +32,7 @@ def syntax_focused_code_generation(state: dict, analysis: str, llm_model) -> str prompt = PromptTemplate(template=TEMPLATE_SYNTAX_CODE_GENERATION, input_variables=["analysis", "generated_code"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "analysis": analysis, "generated_code": state["generated_code"] }) @@ -52,7 +52,7 @@ def execution_focused_code_generation(state: dict, analysis: str, llm_model) -> prompt = PromptTemplate(template=TEMPLATE_EXECUTION_CODE_GENERATION, input_variables=["analysis", "generated_code"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "analysis": analysis, "generated_code": state["generated_code"] }) @@ -72,7 +72,7 @@ def validation_focused_code_generation(state: dict, analysis: str, llm_model) -> prompt = PromptTemplate(template=TEMPLATE_VALIDATION_CODE_GENERATION, input_variables=["analysis", "generated_code", "json_schema"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "analysis": analysis, "generated_code": state["generated_code"], "json_schema": state["json_schema"] @@ -93,7 +93,7 @@ def semantic_focused_code_generation(state: dict, analysis: str, llm_model) -> s prompt = PromptTemplate(template=TEMPLATE_SEMANTIC_CODE_GENERATION, input_variables=["analysis", "generated_code", "generated_result", "reference_result"]) chain = prompt | llm_model | StrOutputParser() - return chain.ainvoke({ + return chain.invoke({ "analysis": analysis, "generated_code": state["generated_code"], "generated_result": json.dumps(state["execution_result"], indent=2), From 931b975d7992111231eaa2df49b445dbb8f5b78b Mon Sep 17 00:00:00 2001 From: semantic-release-bot Date: Sun, 13 Oct 2024 09:32:08 +0000 Subject: [PATCH 13/13] ci(release): 1.26.5 [skip ci] ## [1.26.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.4...v1.26.5) (2024-10-13) ### Bug Fixes * async invocation ([c2179ab](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c2179abc60d1242f272067eaca4750019b6f1d7e)) --- CHANGELOG.md | 7 +++++++ pyproject.toml | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/CHANGELOG.md b/CHANGELOG.md index 184c2c36..cbe12a5a 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,10 @@ +## [1.26.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.4...v1.26.5) (2024-10-13) + + +### Bug Fixes + +* async invocation ([c2179ab](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/c2179abc60d1242f272067eaca4750019b6f1d7e)) + ## [1.26.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.26.3...v1.26.4) (2024-10-13) diff --git a/pyproject.toml b/pyproject.toml index b2aedfd8..6bade627 100644 --- a/pyproject.toml +++ b/pyproject.toml @@ -1,7 +1,7 @@ [project] name = "scrapegraphai" -version = "1.26.4" +version = "1.26.5" description = "A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines." authors = [