Visitar URL original
fix: re-export generated params from the IR the package was built fro… · Decodo/sdk-python@195c329 · GitHub
Skip to content

Commit 195c329

Browse files
fix: re-export generated params from the IR the package was built from (#11)
1 parent 8da06f3 commit 195c329

11 files changed

Lines changed: 87 additions & 378 deletions

File tree

‎.github/workflows/test.yml‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,3 +29,9 @@ jobs:
2929
run: |
3030
pip install build
3131
python -m build
32+
33+
- name: Import typed params from the wheel
34+
run: |
35+
python -m venv /tmp/wheel-env
36+
/tmp/wheel-env/bin/pip install dist/*.whl
37+
cd /tmp && /tmp/wheel-env/bin/python -c "import decodo; assert decodo._codegen_available; from decodo import ScrapeRequest"

‎.github/workflows/workflow.yml‎

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,13 @@ jobs:
6464
pip install build
6565
python -m build
6666
67+
- name: Import typed params from the wheel
68+
if: steps.release.outputs.released == 'true'
69+
run: |
70+
python -m venv /tmp/wheel-env
71+
/tmp/wheel-env/bin/pip install dist/*.whl
72+
cd /tmp && /tmp/wheel-env/bin/python -c "import decodo; assert decodo._codegen_available; from decodo import ScrapeRequest"
73+
6774
- name: Publish to PyPI
6875
if: steps.release.outputs.released == 'true'
6976
uses: pypa/gh-action-pypi-publish@release/v1

‎README.md‎

Lines changed: 0 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -545,13 +545,8 @@ Each target accepts one primary input parameter (`url`, `query`, `product_id`, o
545545
| Target | Parameter class | Description | Example input |
546546
| ------------------------------ | ----------------------------- | --------------------------------- | ---------------------------------------- |
547547
| `Target.GoogleSearch` | `GoogleSearchParams` | Google Search results for a query | `query="coffee shops"` |
548-
| `Target.GoogleMaps` | `GoogleMapsParams` | Google Maps search results | `query="coffee shops brooklyn"` |
549-
| `Target.GoogleShoppingSearch` | `GoogleShoppingSearchParams` | Google Shopping search results | `query="laptop"` |
550-
| `Target.GoogleShoppingProduct` | `GoogleShoppingProductParams` | Google Shopping product page | `query="laptop"` |
551-
| `Target.GoogleSuggest` | `GoogleSuggestParams` | Google Autocomplete suggestions | `query="coffee"` |
552548
| `Target.GoogleLens` | `GoogleLensParams` | Google Lens reverse image search | `query="https://example.com/cat.jpg"` |
553549
| `Target.GoogleTravelHotels` | `GoogleTravelHotelsParams` | Google Travel hotel listings | `query="hotels in paris"` |
554-
| `Target.GoogleTrendsExplore` | `GoogleTrendsExploreParams` | Google Trends explore data | `query="coffee"` |
555550
| `Target.GoogleAds` | `GoogleAdsParams` | Google Ads results for a query | `query="laptop"` |
556551
| `Target.BingSearch` | `BingSearchParams` | Bing Search results | `query="electric vehicles"` |
557552
| `Target.Bing` | `BingParams` | Raw Bing URL scraping | `url="https://bing.com/search?q=laptop"` |
@@ -571,8 +566,6 @@ Each target accepts one primary input parameter (`url`, `query`, `product_id`, o
571566
| `Target.TargetProduct` | `TargetProductParams` | Target.com product page by product ID | `product_id="92186007"` |
572567
| `Target.TargetSearch` | `TargetSearchParams` | Target.com search results | `query="laptop"` |
573568
| `Target.Target` | `TargetStoreParams` | Raw Target.com URL scraping | `url="https://target.com/p/-/A-92186007"` |
574-
| `Target.LowesSearch` | `LowesSearchParams` | Lowe's search results | `query="drill"` |
575-
| `Target.Ecommerce` | `EcommerceParams` | Generic eCommerce page with parser | `url="https://example.com/product/123"` |
576569

577570
### Social media
578571

@@ -581,18 +574,14 @@ Each target accepts one primary input parameter (`url`, `query`, `product_id`, o
581574
| `Target.RedditPost` | `RedditPostParams` | Reddit post by URL | `url="https://reddit.com/r/nba/comments/..."` |
582575
| `Target.RedditSubreddit` | `RedditSubredditParams` | Reddit subreddit by URL | `url="https://reddit.com/r/nba/"` |
583576
| `Target.RedditUser` | `RedditUserParams` | Reddit user profile by URL | `url="https://reddit.com/user/example/"` |
584-
| `Target.YoutubeVideo` | `YoutubeVideoParams` | YouTube video by ID | `query="dFu9aKJoqGg"` |
585577
| `Target.YoutubeSearch` | `YoutubeSearchParams` | YouTube search results | `query="ambient music"` |
586-
| `Target.YoutubeSearchMax` | `YoutubeSearchMaxParams` | YouTube search results (extended) | `query="ambient music"` |
587578
| `Target.YoutubeMetadata` | `YoutubeMetadataParams` | YouTube video metadata by ID | `query="dFu9aKJoqGg"` |
588-
| `Target.YoutubeTranscript` | `YoutubeTranscriptParams` | YouTube video transcript by ID | `query="dFu9aKJoqGg"` |
589579
| `Target.YoutubeSubtitles` | `YoutubeSubtitlesParams` | YouTube video subtitles by ID | `query="dFu9aKJoqGg"` |
590580
| `Target.YoutubeChannel` | `YoutubeChannelParams` | YouTube channel by handle or ID | `query="@decodo_official"` |
591581
| `Target.TiktokPost` | `TiktokPostParams` | TikTok post by URL | `url="https://www.tiktok.com/@nba/video/..."` |
592582
| `Target.TiktokShopSearch` | `TiktokShopSearchParams` | TikTok Shop search results | `query="wireless earbuds"` |
593583
| `Target.TiktokShopProduct` | `TiktokShopProductParams` | TikTok Shop product page by product ID | `product_id="7100000000000000000"` |
594584
| `Target.Tiktok` | `TiktokParams` | Raw TikTok URL scraping | `url="https://www.tiktok.com/@nba"` |
595-
| `Target.InstagramGraphqlProfile` | `InstagramGraphqlProfileParams` | Instagram profile via GraphQL | `query="nba"` |
596585

597586
### AI tools
598587

@@ -621,8 +610,6 @@ Each target accepts one primary input parameter (`url`, `query`, `product_id`, o
621610
| `Target.Google` | `GoogleParams` | Raw Google URL scraping | `url="https://google.com/search?q=laptop"` |
622611
| `Target.Amazon` | `AmazonParams` | Raw Amazon URL scraping | `url="https://amazon.com/dp/B09H74FXNW"` |
623612

624-
> `Target.UniversalEcommerce` isn't listed above because it doesn't accept a primary input parameter like `url`, `query`, `product_id`, or `prompt`. Its parameter class `UniversalEcommerceParams` only accepts optional configuration fields such as `callback_url`.
625-
626613
For the full target list and parameter details, see the API documentation:
627614

628615
- [Target list](https://help.decodo.com/docs/web-scraping-api-targets)

‎examples/web_scraping_api/google_maps.py‎

Lines changed: 0 additions & 29 deletions
This file was deleted.

‎examples/web_scraping_api/google_shopping_search.py‎

Lines changed: 0 additions & 29 deletions
This file was deleted.

‎examples/web_scraping_api/google_trends_explore.py‎

Lines changed: 0 additions & 27 deletions
This file was deleted.

‎examples/web_scraping_api/instagram_profile.py‎

Lines changed: 0 additions & 27 deletions
This file was deleted.

‎examples/web_scraping_api/youtube_search_max.py‎

Lines changed: 0 additions & 28 deletions
This file was deleted.

0 commit comments

Comments
 (0)