URLDownloadtoFile,Webscraping, WinHTTPrequests and more

Post a reply


In an effort to prevent automatic submissions, we require that you complete the following challenge.
Smilies
:D :) ;) :( :o :shock: :? 8-) :lol: :x :P :oops: :cry: :evil: :twisted: :roll: :!: :?: :idea: :| :mrgreen: :geek: :ugeek: :arrow: :angel: :clap: :crazy: :eh: :lolno: :problem: :shh: :shifty: :sick: :silent: :think: :thumbup: :thumbdown: :salute: :wave: :wtf: :yawn: :facepalm: :bravo: :dance: :beard: :morebeard: :xmas: :HeHe: :trollface: :cookie: :rainbow: :monkeysee: :monkeysay: :happybday: :headwall: :offtopic: :superhappy: :terms: :beer:
View more smilies
BBCode is ON
[img] is OFF
[flash] is OFF
[url] is ON
Smilies are ON
Topic review
   

Expand view Topic review: URLDownloadtoFile,Webscraping, WinHTTPrequests and more

Re: URLDownloadtoFile,Webscraping, WinHTTPrequests and more

Post by neogna2 » 07 Apr 2021, 10:56

Nice discussion! I'd be interested in a follow up that covers a few issues I haven't seen covered in the help file or forum topics on URL downloading.
- security: Are some download/scraping methods using less secure connections? Is that dependent on some settings in IE or wherever?
- privacy: Are downloads/scraping that use IE, Chrome and similar tools by default added to the browser history or otherwise logged in the system?
- speed: Are some download/scraping method faster than others, when downloading larger files. For example curl.exe vs UrlDownloadToFile vs others.

Re: URLDownloadtoFile,Webscraping, WinHTTPrequests and more

Post by Delta Pythagorean » 04 Apr 2021, 18:04

Wouldn't this go in Tutorials?

URLDownloadtoFile,Webscraping, WinHTTPrequests and more

Post by Joe Glines » 03 Apr 2021, 08:12

If you're new to web scraping, API calls, and http protocol, this is a great discussion you need to see!
Web scraping, APIS and HTTP Traffic
If you're trying to use URLdownloadtoFile, WinHTTPRequest, or automate Chrome, this is a great overview of the high-level principles of what you're doing and different approaches.

Top