AutoHotkey Community

ctech wrote: ↑

05 Sep 2022, 08:47

Hi!

this looks amazing and seems to be exactly what I was looking for!

Unfortunately I'm running in a bit of trouble while trying to load a session with a user Profile.

Code: Select all

#Include Rufaydium.ahk
Chrome := new Rufaydium("chromedriver.exe")
Chrome.capabilities.setUserProfile("Profile 1")
Page := Chrome.NewSession()
Page.Navigate("https://www.autohotkey.com/")

This works if I have no chrome window open. However if there are other Chrome windows open (not created by chromedriver.exe) it stops working and produces the following error:
image.png
Unhiding the chromedriver window produces the following message when trying to create the session:
image.png
which roughly translates to "Is being opened in a currunt browser session."

Chrome starts with the correct profile but it seems there is no Session attached to it (or at least not available in the "Page" variable).

This also occurs if I have chrome open with a different profile, e.g. Profile 2.

Also if I try to create a second session in the first scenario where no instance of chrome was open before launching the script, it gives me the same error. Without loading a profile I can create several sessions with Chrome.NewSession() without problem.

#Include Rufaydium.ahk
UserDataDir := a_scriptdir "\ChromeUserDATA\"
Profile := "Profile 1"

if !fileexist(UserDataDir) ; create dir if not there
	FilecreateDir, % UserDataDir
if !fileexist(UserDataDir Profile) ; create dir if not there
	FilecreateDir, % UserDataDir Profile
Chrome := new Rufaydium("chromedriver.exe")
Chrome.capabilities.setUserProfile(Profile, UserDataDir ) ; passing  custom userdatadir 
Page := Chrome.NewSession()
Page.Url := "https://www.autohotkey.com/"

yousef_badr23 wrote: ↑

25 Sep 2022, 04:17

I am trying to get headless mode for chrome to work on my project (following updates on my amazon orders), but I wouldn't get many of the elements unless i turned headless mode off. I tried both

Code: Select all

browser.capabilities.HeadlessMode := True

and

Code: Select all

browser.capabilities.addArg(" --window-size=1920,1080 ")
browser.capabilities.addArg(" --start-maximized ")
browser.capabilities.addArg(" --headless ") 
browser.capabilities.addArg(" --ignore-certificate-errors ")
browser.capabilities.addArg(" --allow-running-insecure-content ") ;needed for headless
browser.capabilities.addArg(" --disable-gpu ")
browser.capabilities.addArg(" --user-agent=Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.50 Safari/537.36 ")

to no avail. After tinkering a bit and viewing the site html. I discovered an error in the headless mode (Please enable cookies & sign in, in case the preview doesn't work), while without the headless mode i can get all the elements I need.
How to fix this?
Thanks for this awesome library!

arimania wrote: ↑

10 Oct 2022, 23:14

Sorry admin please delete the last 2 unapproved post, this is the revised post.

Hi i have a question, why the 'innerText' and 'textContent' NotWorking to get the value of second 'span', this use with ChromeDriver.
isnpect00000117014976.PNG

Code: Select all

<div class="price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl" data-purpose="course-price-text"><span class="udlite-sr-only">Current</span><span>Free</span></div>

i tried the possibilities, when using console on inspect element it show the value, but in rufaydium, not value at all.

Code: Select all

aa1 := Page.getElementsByClassName("price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].textContent
aa2 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl""]")[0].getElementsByTagName("span")[1].innerText
aa21 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].textContent
aa3 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl""]")[0].getElementsByTagName("span")[1].innerText
aa4 := Page.getElementsByClassName("price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].innerText
aa5 := Page.CDP.Evaluate("document.getElementsByClassName('price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl')[0].getElementsByTagName('span')[1].textContent;").value
MsgBox, aa2= %aa2% `r`n aa21=%aa21% `r`n aa3= %aa3% `r`n aa4 = %aa4% `r`n aa5= %aa5%

The Second, how to get the value of Page.GetTabs(), THIS also not showing any value. See the Full Code

Code: Select all

#SingleInstance Force
#Include Rufaydium.ahk
#Include CDP.ahk
Chrome := new Rufaydium("chromedriver.exe")

Page := Chrome.NewSession()
Page.CDP.Document()
TestWithIsLoading := 1 ;not working
;TestWithIsLoading := 0 ;working
Loop,
{
	if (Clipboard !="" && InStr(Clipboard, "foo")>0 )     
	{
		url_0 := Clipboard
		Page.Navigate(url_0)
		sleep, 1000
		historysaved := url_0 . "`r`n"
		FileAppend, url_0. "`r`n", D:\aarun2\AutohotkeyArea\Ruvaydium\Rufaydium-Webdriver-main\myhistory.txt
		;ini url dengan isi udemy link.
		url_1 := Page.getElementsByClassName("rh_button_wrapper")[0].getElementsByTagName("a")[0].href
		Page.getElementsByClassName("rh_button_wrapper")[0].getElementsByTagName("a")[0].click()
	    
		;What CODE to make sure not to close the last opened aka url_1 aka Second Tab but the just close  the First Tab
		;How to Make sure it is not closed the tab with url_1 because of the switchicng time/Loading not always in 1 seconds, how to make it dynamically.
		Page.SwitchbyURL(url_0)
		MsgBox, % Page.GetTabs()        ;<=== this also empty
		MsgBox, % Page.GetTabs().value  ;<=== this also empty
		Sleep 1000
		Page.close()
 

		aa1 := Page.getElementsByClassName("price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].textContent
        aa2 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl""]")[0].getElementsByTagName("span")[1].innerText
		aa21 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].textContent
		aa3 := Page.QuerySelector("[class=""price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl""]")[0].getElementsByTagName("span")[1].innerText
		aa4 := Page.getElementsByClassName("price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl")[0].getElementsByTagName("span")[1].innerText
		aa5 := Page.CDP.Evaluate("document.getElementsByClassName('price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl')[0].getElementsByTagName('span')[1].textContent;").value
		aa51 := Page.CDP.Evaluate("document.getElementsByClassName('price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl')[0].getElementsByTagName('span')[1].textContent;").value
		
		MsgBox, aa1= %aa1% `r`n aa2= %aa2% `r`n aa21=%aa21% `r`n aa3= %aa3% `r`n aa4 = %aa4% `r`n aa5= %aa5% `r`n aa51= %aa51%
		
		if ( %aa2% == "Free" ){
			
			If TestWithIsLoading ;not working
			  {
				;this forum user said this not working so just make it empty
			  }
			else ;working
			  {
				;Wait until Button "Free" is available
				MyButton := ""
				While !IsObject(MyButton)
				  {
					sleep, 200
					MyButton := Page.findelement(by.linktext,"Add to cart") ;Partial link text
					MyButton.click() ;Click on ATC Button
				  }
			  }
		;Page.getElementsByClassName("udlite-btn udlite-btn-large udlite-btn-brand udlite-heading-md add-to-cart")[0].click()
		
		}else{
		MsgBox, 64, Var ab2 Contents, %Clipboard% `r`n`r`nthis will closed on 3 seconds, 5
	    }
		
		
		Pause	
    } else {
		Sleep, 2000
	}
}
return

^b::
InputBox, asb, Masukkan Url, 
if (asb !=""){
	if (InStr(asb, "tutorialbar")>0 =){
		Page.Navigate(asb)
	}
}
return


^m::
Chrome.QuitAllSessions() ; close all session 
Chrome.Driver.Exit() ; then exits driver
return

^d::Pause
Return

aa2 := Page.QuerySelector("[class='price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl']").getElementsByTagName("span")[1].innerText

e := Page.QuerySelector("[class='price-text--price-part--2npPm udlite-clp-discount-price udlite-heading-xxl']")
msgbox, % e.innerText
msgbox, % e.textContent

yousef_badr23 wrote: ↑

25 Sep 2022, 07:14

yousef_badr23 wrote: ↑

25 Sep 2022, 04:17

I am trying to get headless mode for chrome to work on my project (following updates on my amazon orders), but I wouldn't get many of the elements unless i turned headless mode off. I tried both

Code: Select all

browser.capabilities.HeadlessMode := True

and

Code: Select all

browser.capabilities.addArg(" --window-size=1920,1080 ")
browser.capabilities.addArg(" --start-maximized ")
browser.capabilities.addArg(" --headless ") 
browser.capabilities.addArg(" --ignore-certificate-errors ")
browser.capabilities.addArg(" --allow-running-insecure-content ") ;needed for headless
browser.capabilities.addArg(" --disable-gpu ")
browser.capabilities.addArg(" --user-agent=Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.50 Safari/537.36 ")

to no avail. After tinkering a bit and viewing the site html. I discovered an error in the headless mode (Please enable cookies & sign in, in case the preview doesn't work), while without the headless mode i can get all the elements I need.
How to fix this?
Thanks for this awesome library!

This is the html (document.queryselector(body).outerhtml) of the headless amazon page, I also tried other sites that didn't work with headless mode and I wasn't signed in in any of them in headless mode only.
I want to check these sites in the background without any popup or browser, is headless mode the only way(other than minimizing the browser)?

Xeo786 wrote: ↑

11 Oct 2022, 01:35

yousef_badr23 wrote: ↑

25 Sep 2022, 07:14

yousef_badr23 wrote: ↑

25 Sep 2022, 04:17

I am trying to get headless mode for chrome to work on my project (following updates on my amazon orders), but I wouldn't get many of the elements unless i turned headless mode off. I tried both

Code: Select all

browser.capabilities.HeadlessMode := True

and

Code: Select all

browser.capabilities.addArg(" --window-size=1920,1080 ")
browser.capabilities.addArg(" --start-maximized ")
browser.capabilities.addArg(" --headless ") 
browser.capabilities.addArg(" --ignore-certificate-errors ")
browser.capabilities.addArg(" --allow-running-insecure-content ") ;needed for headless
browser.capabilities.addArg(" --disable-gpu ")
browser.capabilities.addArg(" --user-agent=Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.50 Safari/537.36 ")

to no avail. After tinkering a bit and viewing the site html. I discovered an error in the headless mode (Please enable cookies & sign in, in case the preview doesn't work), while without the headless mode i can get all the elements I need.
How to fix this?
Thanks for this awesome library!

This is the html (document.queryselector(body).outerhtml) of the headless amazon page, I also tried other sites that didn't work with headless mode and I wasn't signed in in any of them in headless mode only.
I want to check these sites in the background without any popup or browser, is headless mode the only way(other than minimizing the browser)?

I am sure, You need to try the different combinations of chrome CMD switches, some switches do not work together and some switches disable a bunch of other abilities you need to enable by using more switches, so you need to study and learn about switches, I have dived into these but I need to read all those details again even I might not able to resolve your issue.

I never tried but you can use Autohotkey winhide to hide the chrome, instead using headless mode, I never tried that, I do not know what issue it would cause to Web driver behaviour

separateattention wrote: ↑

19 Oct 2022, 15:45

Hi Xeo, first, thanks for your amazing work.

I have a question, I´m trying to use the "capabilities.setUserProfile", but can't make it work. If I set "MSEdge.capabilities.setUserProfile("Default")", I get the following error:



I'm not using the default profile at all, no open tabs.

If I delete the line, it works without issue but it will always create a temp profile in "C:\Users\...\AppData\Local\Temp\scoped_dir4784_1929702658\Default" for example.

Here's my code:

Code: Select all

#Include %A_ScriptDir%\Lib\
#Include Rufaydium.ahk

MSEdge := new Rufaydium("msedgedriver.exe")
MSEdge.capabilities.setUserProfile("Default")

WB := MSEdge.NewSession()
WB.Navigate("http://...")
Return

MSEdge.capabilities.setUserProfile("Default", appdata "\Microsoft\Edge\User Data") ; 

userDataDir := StrReplace(A_AppData, "\Roaming") "\Local\Microsoft\Edge\User Data

Xeo786 wrote: ↑

21 Oct 2022, 07:16

separateattention wrote: ↑

19 Oct 2022, 15:45

Hi Xeo, first, thanks for your amazing work.

I have a question, I´m trying to use the "capabilities.setUserProfile", but can't make it work. If I set "MSEdge.capabilities.setUserProfile("Default")", I get the following error:



I'm not using the default profile at all, no open tabs.

If I delete the line, it works without issue but it will always create a temp profile in "C:\Users\...\AppData\Local\Temp\scoped_dir4784_1929702658\Default" for example.

Here's my code:

Code: Select all

#Include %A_ScriptDir%\Lib\
#Include Rufaydium.ahk

MSEdge := new Rufaydium("msedgedriver.exe")
MSEdge.capabilities.setUserProfile("Default")

WB := MSEdge.NewSession()
WB.Navigate("http://...")
Return

You might need to provide user data dir as well,

Code: Select all

MSEdge.capabilities.setUserProfile("Default", appdata "\Microsoft\Edge\User Data") ; 

Right now default userdatadir in rufaydium,

Code: Select all

userDataDir := StrReplace(A_AppData, "\Roaming") "\Local\Microsoft\Edge\User Data

I would like to know msedge's default userdatadir as I am on win7 without msedge right now.

hotcheesesoup wrote: ↑

27 Oct 2022, 19:47

@Xeo786

Would it be possible to prevent Chromedriver from closing when I close the active tab, but I have multiple tabs open?

Could it instead activate the next tab in the stack, or activate ANY existing tab in the Session instead of immediately closing?

Thanks!
-HCS

hotcheesesoup wrote: ↑

31 Oct 2022, 01:08

OK cool! Looking forward to the next update then!

hotcheesesoup wrote: ↑

31 Oct 2022, 01:08

I swear it was running fine until Chromedriver updated last week. Now it is kind of wonky.

separateattention wrote: ↑

21 Oct 2022, 14:50

Xeo786 wrote: ↑

21 Oct 2022, 07:16

separateattention wrote: ↑

19 Oct 2022, 15:45

Hi Xeo, first, thanks for your amazing work.

I have a question, I´m trying to use the "capabilities.setUserProfile", but can't make it work. If I set "MSEdge.capabilities.setUserProfile("Default")", I get the following error:



I'm not using the default profile at all, no open tabs.

If I delete the line, it works without issue but it will always create a temp profile in "C:\Users\...\AppData\Local\Temp\scoped_dir4784_1929702658\Default" for example.

Here's my code:

Code: Select all

#Include %A_ScriptDir%\Lib\
#Include Rufaydium.ahk

MSEdge := new Rufaydium("msedgedriver.exe")
MSEdge.capabilities.setUserProfile("Default")

WB := MSEdge.NewSession()
WB.Navigate("http://...")
Return

You might need to provide user data dir as well,

Code: Select all

MSEdge.capabilities.setUserProfile("Default", appdata "\Microsoft\Edge\User Data") ; 

Right now default userdatadir in rufaydium,

Code: Select all

userDataDir := StrReplace(A_AppData, "\Roaming") "\Local\Microsoft\Edge\User Data

I would like to know msedge's default userdatadir as I am on win7 without msedge right now.

Sadly it didn't work but I tested the same code with chrome and there's no problem there, so it's definitely something about edge, I tested a couple changes without luck.

Edge default userdatadir is "C:\Users\...\AppData\Local\Microsoft\Edge\User Data\Default".

A detail that I skipped and could help is that, after the error, Edge does open in the correct profile but there´s no session attached to it.

separateattention wrote: ↑

02 Nov 2022, 11:02

@Xeo786 any idea? I've tried a lot but this is beyond me right now

#include Rufaydium.ahk

F1::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Default") ; this load profile 1 according to image
Page := EG.NewSession()
Page.url := "https://www.autohotkey.com/boards/"
return

F2::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Profile 1") ; this will load profile 2 according to image
Page := EG.NewSession()
return

f12::
EG := new Rufaydium("msedgedriver")
EG.QuitAllSessions() ; close all session 
EG.Driver.Exit() ; then exits driver
msgbox, all session closed and Driver Exitted
return

Xeo786 wrote: ↑

03 Nov 2022, 05:37

separateattention wrote: ↑

02 Nov 2022, 11:02

@Xeo786 any idea? I've tried a lot but this is beyond me right now

Just fixed a bug in loading User profile, there are a few things you need to take care.
1) make sure Edge is running and using that profile you want to access with webdriver, profile dir already in use will cause webdriver error
2) if you somehow run MS edge with webdriver while profile was already in use webdriver will crash, you need to kill all MS edge process and Runtime breaker processes, to make MS Edge Webdriver work
3) edge://profile-internals/ run this URL to check Profile DIR location on edge, just ignore Local Profile Name use actual Profile DIR name from profile path

here is example

Spoiler

Code: Select all

#include Rufaydium.ahk

F1::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Default") ; this load profile 1 according to image
Page := EG.NewSession()
Page.url := "https://www.autohotkey.com/boards/"
return

F2::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Profile 1") ; this will load profile 2 according to image
Page := EG.NewSession()
return

f12::
EG := new Rufaydium("msedgedriver")
EG.QuitAllSessions() ; close all session 
EG.Driver.Exit() ; then exits driver
msgbox, all session closed and Driver Exitted
return

separateattention wrote: ↑

03 Nov 2022, 17:29

Xeo786 wrote: ↑

03 Nov 2022, 05:37

separateattention wrote: ↑

02 Nov 2022, 11:02

@Xeo786 any idea? I've tried a lot but this is beyond me right now

Just fixed a bug in loading User profile, there are a few things you need to take care.
1) make sure Edge is running and using that profile you want to access with webdriver, profile dir already in use will cause webdriver error
2) if you somehow run MS edge with webdriver while profile was already in use webdriver will crash, you need to kill all MS edge process and Runtime breaker processes, to make MS Edge Webdriver work
3) edge://profile-internals/ run this URL to check Profile DIR location on edge, just ignore Local Profile Name use actual Profile DIR name from profile path

here is example

Spoiler

Code: Select all

#include Rufaydium.ahk

F1::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Default") ; this load profile 1 according to image
Page := EG.NewSession()
Page.url := "https://www.autohotkey.com/boards/"
return

F2::
EG := new Rufaydium("msedgedriver")
EG.capabilities.setUserProfile("Profile 1") ; this will load profile 2 according to image
Page := EG.NewSession()
return

f12::
EG := new Rufaydium("msedgedriver")
EG.QuitAllSessions() ; close all session 
EG.Driver.Exit() ; then exits driver
msgbox, all session closed and Driver Exitted
return

Thanks a lot Xeo, now it's working.

cz_luckyluke99 wrote: ↑

04 Nov 2022, 07:42

Hi all,

what helped me with profile loading:

MSEdge:= new Rufaydium("msedgedriver.exe","--port=9516")
MSEdge.capabilities.addArg("--no-sandbox")
MSEdge.capabilities.addArg("--disable-dev-shm-usage")
MSEdge.capabilities.setUserProfile("Default")

MSEdge:= new Rufaydium("msedgedriver.exe","--port=9516")
MSEdge.capabilities.addArg("--no-sandbox")
MSEdge.capabilities.addArg("--disable-dev-shm-usage")
MSEdge.capabilities.setUserProfile("Default")

Page := MSEdge.NewSession() ; to create session
Page.url := "https://www.autohotkey.com/boards/" ; to navigate url

msgbox, press ok to close all sessions and exit
MSEdge.QuitAllSessions() ; close all session 
MSEdge.Driver.Exit() ; then exits driver
msgbox, all session closed and Driver Exitted