If you're new to web scraping, API calls, and http protocol, this is a great discussion you need to see!
Web scraping, APIS and HTTP Traffic
If you're trying to use URLdownloadtoFile, WinHTTPRequest, or automate Chrome, this is a great overview of the high-level principles of what you're doing and different approaches.
URLDownloadtoFile,Webscraping, WinHTTPrequests and more
- Joe Glines
- Posts: 770
- Joined: 30 Sep 2013, 20:49
- Location: Dallas
- Contact:
URLDownloadtoFile,Webscraping, WinHTTPrequests and more
Sign-up for the HK Newsletter
AHK Tutorials:Web Scraping | | Webservice APIs | AHK and Excel | Chrome | RegEx | Functions
Training: AHK Webinars Courses on AutoHotkey
YouTube
Quick Access Popup, the powerful Windows folders, apps and documents launcher!
AHK Tutorials:Web Scraping | | Webservice APIs | AHK and Excel | Chrome | RegEx | Functions
Training: AHK Webinars Courses on AutoHotkey
YouTube
Quick Access Popup, the powerful Windows folders, apps and documents launcher!
- Delta Pythagorean
- Posts: 627
- Joined: 13 Feb 2017, 13:44
- Location: Somewhere in the US
- Contact:
Re: URLDownloadtoFile,Webscraping, WinHTTPrequests and more
Wouldn't this go in Tutorials?
[AHK]......: v2.0.12 | 64-bit
[OS].......: Windows 11 | 23H2 (OS Build: 22621.3296)
[GITHUB]...: github.com/DelPyth
[PAYPAL]...: paypal.me/DelPyth
[DISCORD]..: tophatcat
Re: URLDownloadtoFile,Webscraping, WinHTTPrequests and more
Nice discussion! I'd be interested in a follow up that covers a few issues I haven't seen covered in the help file or forum topics on URL downloading.
- security: Are some download/scraping methods using less secure connections? Is that dependent on some settings in IE or wherever?
- privacy: Are downloads/scraping that use IE, Chrome and similar tools by default added to the browser history or otherwise logged in the system?
- speed: Are some download/scraping method faster than others, when downloading larger files. For example curl.exe vs UrlDownloadToFile vs others.
- security: Are some download/scraping methods using less secure connections? Is that dependent on some settings in IE or wherever?
- privacy: Are downloads/scraping that use IE, Chrome and similar tools by default added to the browser history or otherwise logged in the system?
- speed: Are some download/scraping method faster than others, when downloading larger files. For example curl.exe vs UrlDownloadToFile vs others.
Return to “Off-topic Discussion”
Who is online
Users browsing this forum: No registered users and 85 guests