Rufaydium WebDriver 1.7.2 (no selenium/websocket)

[Xeo786]

* Manually downloaded and putted cromedriver for chrome 103. I've put it to \chromedriver_win32\file.ahk folder

Yah you can download driver but the best practice is to let Rufaydium download the driver, if browser version mismatches it will let you know and ask to download that driver version to match your browser.

You can also provide the driver's location,

Code: Select all

; untested
Chrome := new Rufaydium("C:\DriverTemp\chromedriver.exe") ; if driver is not there Rufaydium will download driver, if available it will load driver 

providing that location will load the driver but I do not remember testing driver download, I just marked this down and will test it soon,

I am not sure about that error it might be browser error, Please check the following things,
1) Check task manager, No chromedriver.exe is running in the background, kill it before running Rufaydium code.
2) Driver run and occupy a port, Driver will fail to run if that port is occupied, link for default ports.

[Xeo786]

Can i wait user to click a specified button and then continue?

why not use automation? just write a code to automatically click the button with the specific condition.

Make a code wait is very simple, Just put some conditions to make it sleep while something is not visible/vanished/done/undone Etc.

but specifying some buttons while the code is waiting, it would be a bit complicated

You can use settimer, so the script will execute (not so simple) code while waiting,
but the question is how you specify the button.

[usafer]

* Manually downloaded and putted cromedriver for chrome 103. I've put it to \chromedriver_win32\file.ahk folder

Yah you can download driver but the best practice is to let Rufaydium download the driver, if browser version mismatches it will let you know and ask to download that driver version to match your browser.

well... you're right, but I've meant what I did trying to fix it.

You can also provide the driver's location,

Code: Select all

; untested
Chrome := new Rufaydium("C:\DriverTemp\chromedriver.exe") ; if driver is not there Rufaydium will download driver, if available it will load driver 

providing that location will load the driver but I do not remember testing driver download, I just marked this down and will test it soon,

it's working fine and downloads the driver as wished, but doesn't help to use Rufaydium

I am not sure about that error it might be browser error, Please check the following things,
1) Check task manager, No chromedriver.exe is running in the background, kill it before running Rufaydium code.
2) Driver run and occupy a port, Driver will fail to run if that port is occupied, link for default ports.

that's checked.
The 64-bit isn't a problem?

[Xeo786]

The 64-bit isn't a problem?

there is only 32bit Chromedriver, which work for both 32bit/64bit chrome browsers

it's working fine and downloads the driver as wished, but doesn't help to use Rufaydium

So you are still facing that message when you create a new session? that says

Code: Select all

"unknown error: DevToolsActivePort file doesn't exist Stacktrace:"

I have searched about it, and found this, so its chrome+user issue

try use setUserProfile() method, it will load chrome with default user profile

Code: Select all

#include Rufaydium.ahk 
Chrome := new Rufaydium() 
Chrome.capabilities.setUserProfile() ; it will load chrome with default user 

; default userDataDir location
; userDataDir := "C:/Users/" A_UserName "/AppData/Local/Google/Chrome/User Data" ; you can change location here 
; Chrome.capabilities.setUserProfile("Default",userDataDir) ; in case userDataDir  is something else in your windows 

Page := Chrome.NewSession()

; Chromeapp := A_ProgramFiles "\Google\Chrome\Application\chrome.exe"
; Page := Chrome.NewSession(Chromeapp) ; in case executable location is changed for you

Page.url := "https://www.autohotkey.com/boards" ; this navigate just line page.navigate(url)
Msgbox, % Page.Title "`n" Page.URL 
return

I disabled a few lines which are easy to set references for chrome options

[usafer]

@Xeo786, thanks.
It looks like a step in correct direction.

Now I see new Chrome' window but default URL (so script doesn't opens link).

And look what I see: (Screenshot_26.png attachement)

In this case code what used is:

Code: Select all

#include Rufaydium.ahk 
Chrome := new Rufaydium() 
Chrome.capabilities.setUserProfile() ; it will load chrome with default user 

; default userDataDir location
userDataDir := "D:\Users\" A_UserName "/AppData/Local/Google/Chrome/User Data" ; you can change location here 
Chrome.capabilities.setUserProfile("Default",userDataDir) ; in case userDataDir  is something else in your windows 

Page := Chrome.NewSession()

; Chromeapp := A_ProgramFiles "\Google\Chrome\Application\chrome.exe"
; Page := Chrome.NewSession(Chromeapp) ; in case executable location is changed for you

Page.url := "https://www.autohotkey.com/boards" ; this navigate just line page.navigate(url)
Msgbox, % Page.Title "`n" Page.URL 
return

If I commenting the

Code: Select all

Chrome.capabilities.setUserProfile("Default",userDataDir) ; in case userDataDir  is something else in your windows 

I see all as was before.

If I create new profile and choose it like:

Code: Select all

Chrome.capabilities.setUserProfile("Profile 2",userDataDir)

I see same (busy profile message)

OK, then I thought to use maybe portable chrome?
I've choosed portableapps with chrome beta and changed the code:

Code: Select all

#include Rufaydium.ahk 
Chrome := new Rufaydium() 
userDataDir := "C:\PortableApps\GoogleChromePortableBeta\Data\profile" ; you can change location here 
Chrome.capabilities.setUserProfile("Profile 2",userDataDir) ; in case userDataDir  is something else in your windows 

Page := Chrome.NewSession()

Chromeapp := "C:\PortableApps\GoogleChromePortableBeta\App\Chrome-bin\chrome.exe"
Page := Chrome.NewSession(Chromeapp) ; in case executable location is changed for you

Page.url := "https://www.autohotkey.com/boards" ; this navigate just line page.navigate(url)
Msgbox, % Page.Title "`n" Page.URL 
return

...and that helps!

BUT! I still get that error what I've show you before (screenshot25.png attachement). Why?

And maybe an idea:
I've test it using my laptop and all working fine.
Not sure, but... Is any win11 users here? Maybe win11 doesn't allows to operate with Chrome profile folders?

[Xeo786]

@usafer
It feels like file access privilege issue for ChromeDriver.exe, actually Autohotkey runs chromedriver, Win11 takes it as Process(chromedriver) not being run by the user probably.

try create a director in other than 'C:'. May be 'D:' or 'E:' driver, and pass that location as "userDataDir". check if driver can access that location

[murataygun]

Can i wait user to click a specified button and then continue?

why not use automation? just write a code to automatically click the button with the specific condition.

Make a code wait is very simple, Just put some conditions to make it sleep while something is not visible/vanished/done/undone Etc.

but specifying some buttons while the code is waiting, it would be a bit complicated

You can use settimer, so the script will execute (not so simple) code while waiting,
but the question is how you specify the button.

Thank you,

User has to input captcha text to the input box than click the ok button. I cant automate captchas. Bu now i think.. Captcha text is fixed size. 6 letters. Maybe i can click the button when input box has 6 letters. i'll think about it.

[noorudin]

trying to access the [clear data](as 0 and 4 indicated) button inside the [clear browsing data] in the settings page of chrome, steps to indication 2 were fine, but failed at the indication 3.(as below screenshot)

settings of chrome

settings.png (170.38 KiB) Viewed 3381 times

the code went wrong to the indication 3. as showing below

Code: Select all

#SingleInstance, force
#Include %A_ScriptDir%\Rufaydium.ahk
{	; ** ChromeDriver **
	Browser:=new Rufaydium()
	Page:=Browser.NewSession()
}
	Page.Navigate("chrome://settings/privacy")
	If IsObject(Page){
		elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page").shadow().querySelector("settings-clear-browsing-data-dialog")
		MsgBox,,, % json.dump(elem)
	}

Page.Quit()
Page.Close()

Browser.QuitAllSessions()
Browser.Exit()
return

the wrong message showing below:

step_3.png (22.26 KiB) Viewed 3381 times

if I commented the last querySelector, like this:

Code: Select all

elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page").shadow()
;.querySelector("settings-clear-browsing-data-dialog")

I can access the shadow-root, as showing below:

step_2.png (7.53 KiB) Viewed 3381 times

if I commented the last shadow(), like this:

Code: Select all

elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page")
;.shadow()

I cad access the "settings-privacy-page" element as well.
I had try it many times but always failed at indication 3.
could someone know what's wrong with me or else?

[MoUse_G]

I can't login to gmail, when using Rufaydium with chromedriver and geckodriver. Has anyone had the same experience with this?

[Xeo786]

I can't login to gmail, when using Rufaydium with chromedriver and geckodriver. Has anyone had the same experience with this?

You can load a chrome profile that may have already logged in Gmail, .setUserProfile("Profile 1")

[Xeo786]

trying to access the [clear data](as 0 and 4 indicated) button inside the [clear browsing data] in the settings page of chrome, steps to indication 2 were fine, but failed at the indication 3.(as below screenshot)
settings.png
the code went wrong to the indication 3. as showing below

Code: Select all

#SingleInstance, force
#Include %A_ScriptDir%\Rufaydium.ahk
{	; ** ChromeDriver **
	Browser:=new Rufaydium()
	Page:=Browser.NewSession()
}
	Page.Navigate("chrome://settings/privacy")
	If IsObject(Page){
		elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page").shadow().querySelector("settings-clear-browsing-data-dialog")
		MsgBox,,, % json.dump(elem)
	}

Page.Quit()
Page.Close()

Browser.QuitAllSessions()
Browser.Exit()
return

the wrong message showing below:
step_3.png
if I commented the last querySelector, like this:

Code: Select all

elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page").shadow()
;.querySelector("settings-clear-browsing-data-dialog")

I can access the shadow-root, as showing below:
step_2.png
if I commented the last shadow(), like this:

Code: Select all

elem:=Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow().querySelector("#basicPage").querySelector("settings-section:nth-child(9)").querySelector("settings-privacy-page")
;.shadow()

I cad access the "settings-privacy-page" element as well.
I had try it many times but always failed at indication 3.
could someone know what's wrong with me or else?

You need to look carefully into html tree while dealing with the shadow, I have pointed out where you missed trail.

Code: Select all

; no need to do it one line you cannot test it in chrome console so you need to go step by step storing every element into a variable and checking while debugging.
elem := Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow()
; .querySelector("#basicPage") ; skipping  coz we do not need to get to #basicPage

; using querySelectorAll instead to get all settings-section and stored array[4] into variable
elem := elem.querySelectorAll("settings-section")[4] 
elem  := elem.querySelector("settings-privacy-page").shadow()
elem := elem.querySelector("settings-clear-browsing-data-dialog").shadow()
elem := elem.querySelector("cr-dialog") ; .shadow() no need switch shadow here
elem := elem.querySelector("#clearBrowsingDataConfirm")
msgbox, % "press on to click that button `nyou got html: `n" elem.outerhtml 
elem.click() ;will press the button

[noorudin]

@Xeo786
Ah~! I'm a newbie, I'm learning on Rufaydium hardly, my brother! thanks!
as newbie, I can't reply Ur private message, coz the rule of this forum.
I'm from Taiwan, my borther. Salam!

[noorudin]

@Xeo786
following ur code, steps to:

Code: Select all

elem := Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow()
elem := elem.querySelectorAll("settings-section")[4] 
elem := elem.querySelector("settings-privacy-page").shadow()

were fine for both Urs and mine，then next went wrong:

Code: Select all

elem := elem.querySelector("settings-clear-browsing-data-dialog")

the error occured, was same with mine(as u can see step_3.png of my post) in AHK.
sorry!

[Xeo786]

@Xeo786
following ur code, steps to:

Code: Select all

elem := Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow()
elem := elem.querySelectorAll("settings-section")[4] 
elem := elem.querySelector("settings-privacy-page").shadow()

were fine for both Urs and mine，then next went wrong:

Code: Select all

elem := elem.querySelector("settings-clear-browsing-data-dialog")

the error occured, was same with mine(as u can see step_3.png of my post) in AHK.
sorry!

following code is working for me may be I am using url that searches for 'clearBrowserData', that might be changing HTML

Code: Select all

Page := GetRufaydium("chrome://settings/clearBrowserData?search=clear")
elem := Page.querySelector("settings-ui").shadow().querySelector("#main").shadow().querySelector("settings-basic-page").shadow()
elem := elem.querySelectorAll("settings-section")[4]
elem  := elem.querySelector("settings-privacy-page").shadow()
elem := elem.querySelector("settings-clear-browsing-data-dialog").shadow()
elem := elem.querySelector("cr-dialog")
elem := elem.querySelector("#clearBrowsingDataConfirm")
elem.click() 
return

f12::
Chrome := new Rufaydium() 
Chrome.QuitAllSessions() ; close all session 
Chrome.Driver.Exit() ; then exits driver
msgbox, all session closed and Driver Exitted
return

; GetRufaydium(URL) gets existing session  
; stops us creatting multiple sessions again and again 
; make sure do not manually close driver / chrome.driver.exit()
; by Xeo786
GetRufaydium(URL)
{
	; get chrome driver / runs chrome driver if not running, download driver if available in A_ScriptDir
	; Run Chrome Driver with default parameters and loads deafult capabilities
	Chrome := new Rufaydium() 
	Page := Chrome.getSessionByUrl(URL) ; check page (created by driver) if already exist 
	if !isobject(page) ; checcking if Session with url exist
	{
		Page := Chrome.getSession(1,1) ; try getting first session first tab
		if isobject(page) ; if exist 
			Page.NewTab() ; create new tab instead new session
		else ; if does not exist 
			Page := Chrome.NewSession() ; create new session ; Page.Exit() if any session manually closed by user which causes lag
		Page.Navigate(URL) ; navigate		
	}
	return page 
}

[safetycar]

I'm not sure if it's worth to point this out... Maybe so that the author knows, in case of someone reports problems.
But the unzipping method can fail if you have gone out of windows way and disabled the integration of zip folders in the registry.
Probably an uncommon thing to do.
(In such case there's a namespace error for this.zip and you need to extract the content of the zip before file gets deleted, or you have to find another zip yourself)

[Xeo786]

I'm not sure if it's worth to point this out... Maybe so that the author knows, in case of someone reports problems.
But the unzipping method can fail if you have gone out of windows way and disabled the integration of zip folders in the registry.
Probably an uncommon thing to do.
(In such case there's a namespace error for this.zip and you need to extract the content of the zip before file gets deleted, or you have to find another zip yourself)

Rufaydium also uses WinHttp COM a lot, it's even based on RESTful apis, I wonder if someone has disabled WinHTTP COM and is willing to use dllcall instead, it will make this simple library overcomplicated, anyway.

if you have a third-party extractor and you know how to extract stuff using AHK. then you make personalize changes accordingly into DownloadnExtract() method in WDM.ahk (Web Driver Managment).

hope it will help.

[Milchmann]

Hi @Xeo786 ,

I have come a long way in rewriting my code from Selenium to Rufaydium. It runs very stable. Thanks for your work so far!

But what still doesn't work is
DoubleClickand contextmenu.

Eventlisteners for them are available (see picture).

grafik.png (18.6 KiB) Viewed 2917 times

Code: Select all

	E := driver.QuerySelector("#T0444333 > tbody > tr:nth-child(5)").doubleClick()
	if % e.Error
		MsgBox % e.Error

I get the error message:

unknown command

Lately I get with

Code: Select all

E := driver.cdp.Evaluate("document.querySelector('#keywords').click();")

no reaction either, but also no error message.

Code: Select all

driver.QuerySelector("#keywords").click()

works

What am I doing wrong here?

[Xeo786]

But what still doesn't work is
DoubleClick and contextmenu.

Code: Select all

	E := driver.QuerySelector("#T0444333 > tbody > tr:nth-child(5)").doubleClick()
	if % e.Error
		MsgBox % e.Error

I would like you to try

Code: Select all

driver.QuerySelector("#T0444333 > tbody > tr:nth-child(5)").Execute("var evObj = new MouseEvent('dblclick', {bubbles: true, cancelable: true, view: window});arguments[0].dispatchEvent(evObj);")

Code: Select all

driver.QuerySelector("#keywords").click()

try same thing

Code: Select all

driver.QuerySelector("#keywords").Execute("arguments[0].click()")

I have no clue how to trigger the context menu till now.

[safetycar]

@Xeo786 So it was not worth pointing out . I guess I posted to let others know because it was the first thing I saw trying to set it up, but I didn't expect a big change.
For the rest, I haven't seen much yet but it's looking good.

[Milchmann]

But what still doesn't work is
DoubleClick and contextmenu.

Code: Select all

	E := driver.QuerySelector("#T0444333 > tbody > tr:nth-child(5)").doubleClick()
	if % e.Error
		MsgBox % e.Error

I would like you to try

Code: Select all

driver.QuerySelector("#T0444333 > tbody > tr:nth-child(5)").Execute("var evObj = new MouseEvent('dblclick', {bubbles: true, cancelable: true, view: window});arguments[0].dispatchEvent(evObj);")

Does not work and no errors