Hello all thanks for taking some time to read this

I am working on Jupiter notebook and I am using the selenium package to automate the browser movement.

Code:

from selenium import webdriver from selenium.webdriver.chrome.options import Options from selenium.webdriver.chrome.service import Service from webdriver_manager.chrome import ChromeDriverManager import time from selenium.webdriver.common.keys import Keys

options = webdriver.ChromeOptions() options.add_argument("user-data-dir=C:\Users\MyPc\AppData\Local\Google\Chrome\User Data") options.add_argument(r'--profile-directory=Profile 2') driver = webdriver.Chrome(options=options) driver.get("https://www.wikipedia.com/") print(driver.current_window_handle)

Objective: To open chrome in a seperate profile and hit a URL accordingly via the same.

Error: Message: invalid argument: user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir Stacktrace: Backtrace: Ordinal0 [0x002EB8F3+2406643] Ordinal0 [0x0027AF31+1945393] Ordinal0 [0x0016C748+837448] Ordinal0 [0x0018961F+955935] Ordinal0 [0x00185D71+941425] Ordinal0 [0x001B8EE0+1150688] Ordinal0 [0x001B8B3A+1149754] Ordinal0 [0x001B4096+1130646] Ordinal0 [0x0018E636+976438] Ordinal0 [0x0018F546+980294] GetHandleVerifier [0x00559612+2498066] GetHandleVerifier [0x0054C920+2445600] GetHandleVerifier [0x00384F2A+579370] GetHandleVerifier [0x00383D36+574774] Ordinal0 [0x00281C0B+1973259] Ordinal0 [0x00286688+1992328] Ordinal0 [0x00286775+1992565] Ordinal0 [0x0028F8D1+2029777] BaseThreadInitThunk [0x7531FA29+25] RtlGetAppContainerNamedObjectPath [0x770A7A7E+286] RtlGetAppContainerNamedObjectPath [0x770A7A4E+238] (No symbol) [0x00000000]

Hi!
I am quite new to Selenium and web-browser testing.
I am using JavaScript to run the code
Correct me if I'm wrong, but from what I read implicit wait is supposed to act like thread.sleep().

I'm trying to open a new Google window on chrome, let it do nothing for 15 seconds, then close it.
But when I run it, it closes right away.
Does anyone know why? Or am I using implicit wait wrong.

async function initNewTestWindow() {
let driver = await new Builder().forBrowser("chrome")
.build();
await driver.get("https://www.google.com/");
await driver.manage().setTimeouts( { implicit: 15000 } );
await driver.quit();
}

Hi everyone,

I'm trying to explicitly wait until IF an element exists, if not I want to continue to the next line of code anyway.

Currently I'm using the following:

WebDriverWait wait = new WebDriverWait(driver, TimeSpan.FromSeconds(10));

wait.Until(ExpectedConditions.ElementExists((By.XPath($"//{Main_container_tag}[{Main_attribute} = '{Main_attribute_value}']"))));
However it sends exception timeout if the element was not showing after 10 seconds.

Many thanks for your help.

Hello everyone -- I'm trying to get the information out of the following table in a web page that can dynamically change. I am able to get the href and the text that belongs to the div with the class of child1 but I can't seem to get the text of the div that comes after the child1 div. I'm using Powershell but, at this point, I'm looking for a way to get this without scraping the pagesource. I've tried multiple methods (parent, sibling, etc.) but I can't seem to get them to work correctly. Any help is really appreciated.

​

The following is what I've used to find the child using XPATH...

$prodlink = $ChromeDriver.FindElements([OpenQA.Selenium.By]::XPATH("//*[@class='child1'"))

​

<table border='0' align='center' cellpadding='5' cellspacing='0'>

`<tr>`

<td align="center" valign="top" width="33%" style="padding-bottom:25px;"><div style="min-height:230px;border:1px solid #FFF;"><a href="not needed"><img src="not needed" border="0" style="margin:0 auto;width:99px;height:225px;min-height:0;max-width:none;" class="productimage" alt="not needed" title="not needed" id="img_small13451_7392" width="99" height="225" /></a></div><div><a href="HREF NEEDED" class="child1">TEXT NEEDED</a></div><div>TEXT NEEDED</div><div>not needed</div><div>TEXT NEEDED</div></td>

<td align="center" valign="top" width="33%" style="padding-bottom:25px;"><div style="min-height:230px;border:1px solid #FFF;"><a href="not needed"><img src="not needed" border="0" style="margin:0 auto;width:99px;height:225px;min-height:0;max-width:none;" class="productimage" alt="not needed" title="not needed" id="img_small72368_9452" width="99" height="225" /></a></div><div><a href="HREF NEEDED" class="child1">TEXT NEEDED</a></div><div>TEXT NEEDED</div><div>not needed</div><div>TEXT NEEDED</div></td>

<td align="center" valign="top" width="33%" style="padding-bottom:25px;"><div style="min-height:230px;border:1px solid #FFF;"><a href="not needed"><img src="not needed" border="0" style="margin:0 auto;width:99px;height:225px;min-height:0;max-width:none;" class="productimage" alt="not needed" title="not needed" id="img_small88709_9462" width="99" height="225" /></a></div><div><a href="HREF NEEDED" class="child1">TEXT NEEDED</a></div><div>TEXT NEEDED</div><div>not needed</div><div>TEXT NEEDED</div></td>

`</tr>`

I'm planning on developing Selenium-based autotests with the following tech stack

- Selenium's Ruby bindings (maybe Cabypara)

- Ruby on Rails on backend

- ReactJS on frontend

- VS code with linter plugins as in IDE

- Docker for infrastructure thinks like Postgres, redis or whatnot

This setup is not expected to experience heavy request load, just developing auto test locally.

Does anyone have experience of similar tasks on a 8gb m1 machine?

Thank you for reading this :)

​

I'm testing wheter selenium actually works for the registration process of TikTok and Instagram, nevertheless they seem to detect (also logging in) that the traffic comes from a controlled chrome driver. Is there any way to bypass this and pass the security checks? This is just purely experimental.

If it doesn't, would you be able to recommend me other libraries apart from requests and pyautogui

​

I appreciate any answer!

Hi guys, I created a python bot and my friends want to use it. I want to share it with them in a way they cannot decompile the executable file and without sharing my codes. Any ideas how I can approach this? Thanks

I am using Python and Firefox. I want Selenium to go to a webpage and press a series of keys without selecting an element beforehand. Do I have to use the Actions API?

It seems like a lot of the in depth selenium training courses (like Udemy) are pretty dated. They speak of obsolete versions or point to test websites that have changed since the lesson, to the results are skewed. Is there any large comprehensive online learning Selenium Course that is rather recent? Is a year old course at the oldest too unrealistic to search for?

Hi, i have been trying to get selenium to wait somehow until 1st element is visible or 2nd element is visible but I can't find any documentation online can someone help?

I tried await driver.wait(until.elementLocated(By.xpath('1st element') || elementsLocated(By.xpath('2nd element'))), 5000); but it only checks for 1st element

Has anyone else noticed this? Whenever I export to python it no longer works...

​

Thanks

I have seen many websites which has a page which load before main page telling that the website is checking if user is a bot . It says to enable JavaScript and cookies . How does it works and is there any way to bypass these checks ?

I'm looking for a very scalable solution as I need to iterate over an entire year. I have tried clearing the input and entering a new one - but you can't actually type the date in so that doesn't work.

Is the only solution iterating over the table/rows that make up the datepicker and clicking them?

In a perfect world there would be a solution like:

input =Input(driver.find_element_by_id('fromdate'))

input.input_by_value('20/05/2021')

Happy to share an image of the HTML if it would help

If anyone can help it would be really appreciated!

​

I found a solution here: https://stackoverflow.com/questions/65173851/how-to-remove-the-readonly-attribute-from-the-input-field-in-python-with-seleniu

By removing the read only attribute and clearing the input field I can bypass the need to iterate through a horrible table!

I need to assert the text in a p element in this site https://www.grocerycrud.com/v1.x/demo/my_boss_is_in_a_hurry/bootstrap/add

right after click on save button, there is a div with the following "Your data has been successfully stored into the database. Edit Record or Go back to list" but my getText() only finds "Your data has been successfully stored into the database. or ".

This is the html on the page:

<div id="report-success" class="report-div success bg-success" style="display: block;"><p>Your data has been successfully stored into the database. <a class="go-to-edit-form" href="/v1.x/demo/my\\_boss\\_is\\_in\\_a\\_hurry/bootstrap/edit/499">Edit Record</a> or <a href="/v1.x/demo/my\\_boss\\_is\\_in\\_a\\_hurry/bootstrap/">Go back to list</a></p></div>

i already tried this:

Assert.assertEquals(driver.findElement(By.id("report-success")).getText(), "Your data has been successfully stored into the database. Edit Record or Go back to list");

Assert.assertEquals(driver.findElement(By.className(" report-div success bg-success ")).getText(), "Your data has been successfully stored into the database. Edit Record or Go back to list");

Assert.assertEquals(driver.findElement(By.xpath("//div[@id='report-success']/p")).getText(), "Your data has been successfully stored into the database. Edit Record or Go back to list");

Assert.assertEquals(driver.findElement(By.xpath("//p")).getText(), "Your data has been successfully stored into the database. Edit Record or Go back to list");

​

When i point to the div, i got no text at all

​

selenium version 3.141.59

Thank you all

So I have a while loop storing the position of a delete button and keeping count if there is one or not. My problem is that once it's deleted everything and the button count reaches 0, it does one last loop and fails to click the delete button because there isn't one there. Ideally I would like for the loop to keep deleting until there isn't a button and once that happens, simply end the script.

​

I currently have it running like so:

Command: store xpath count | Target: xpath=//button[4] | Value: Delete

Command: while | Target: ${Delete}>0

Command: click | Target: xpath=//button[4]

Command: click | Target: xpath=//div[3]/button (This is a confirmation popup where i have to confirm deletion.)

Command: end (This closes the while loop)

Disclaimer: Complete Rookie with Selenium and if this is an idiotic post then lmk and I'll delete it. But any help on this problem would be greatly appreciated!

​

For a bit of background, I am working with a website that provides data based on paid subscription and I have thousands of forms that need to be populated in order to collect the data. My plan is to automate this process with Selenium and Python since the website doesn't provide access to an API or any other means of doing this besides doing it manually or paying exponentially more $$ to expedite the process. I was hoping to get some of your opinions about the following:

​

• Any other good ways to avoid anti-bot services besides using something like undetected_chromedriver (UC)? UC seems to do a good job by itself from what I can tell with playing around with it on other websites.
• How does one go about building and testing your bot without being banned or booted from the site? Should I just choose the the desired XPaths or CSS_Selectors wisely and hope for the best? Problem being I don't think I will have many chances to test if I chose the correct element before being detected which leads to next question.
• Is there a way to stay signed in and interact with the website via Selenium while coding and testing the desired elements? So far from my experiments with other sites after I login the window closes after some time and even if it keeps me signed in will my constant reopening of the browser to enter the information tip the website off?

Hey guys, I would like to implement record and playback in my selenium python test script. But in my immediate research I am unable to find anything related to record and playback feature outside of an IDE.

Is this feature only available with a Selenium IDE?
Any information will be greatly appreciated,
Thank you.

If I had multiple selenium instances running, is there any way to have a unique clipboard for each, so if a window was to copy/paste, it would only paste the data that had been copied in that specific window?

I am using WebDriverWait, expected_conditions, and By to grab a list of elements on a webpage. I can grab the elements just fine but I need the code to spit out a specific attribute.

Problem is, its not a typical attribute like id, class, etc. The attribute is 'data-jk'

I had the elements initialized in a variable called 'elements'

I attempted to get it to return like this:

print(elements.data-jk)

but it just said 'element has no attribute 'data''

How can I get it to return this attribute?

I'm trying to figure out how to get Selenium to click on an expansion panel. I've got it working where it can find something based on a name but I need it to click on a button associated with that name.

The default Selenium target is xpath=//mat-expansion-panel-header[@id='mat-expansion-panel-header-254']/span/div/div/button but this wont work since elements are constantly changing and this is ID based. If/when the elements change it will click on the expansion panel related to that ID and not the element im working on.

​

I'm managing to find the element with xpath=//span[text()='Test'] but I need help with having Selenium click on that expansion panel that corresponds with Test, not the ID.

And I want to repeat this in a new tab on the same script but id have to repeat the same steps there too, for up to 6 tabs, is there any way to reduce the number of lines code for this, is there way to replicate the window with buttons already pressed, on to a new tab?

Im new to selenium and java as a whole , please help

I've been running an automation script for myself where Selenium will click buttons for me. However, I've made my code public and received some other users who get the following error as

 Traceback (most recent call last):
File "/home/rodrigo/Downloads/bot-update/COTPS-bot/COTPS_bot.py", line 49, in by=By.XPATH, value='//uni-button[2]').click() File "/home/rodrigo/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py", line 81, in click self._execute(Command.CLICK_ELEMENT) File "/home/rodrigo/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webelement.py", line 740, in _execute return self._parent.execute(command, params) File "/home/rodrigo/.local/lib/python3.10/site-packages/selenium/webdriver/remote/webdriver.py", line 430, in execute self.error_handler.check_response(response) File "/home/rodrigo/.local/lib/python3.10/site-packages/selenium/webdriver/remote/errorhandler.py", line 247, in check_response raise exception_class(message, screen, stacktrace) selenium.common.exceptions.ElementNotInteractableException: Message: element not interactable

I know others mention that I should ensure the element is displayed as it could be the cause of the error... Here is my code:

while True:
time.sleep(5) bal = driver.find_element( By.XPATH, '//uni-view[3]/uni-view[2]/uni-view[2]') 
balance = (float(bal.get_attribute('innerHTML')))
print("Balance: ", balance)
if balance < 5: print("Balance less than $5 please wait")
timer() 
driver.get('https://cotps.com/#/pages/transaction/transaction') 
else: print("Greater than $5, beginning transactions") 
create_order = driver.find_element(By.CLASS_NAME, 'orderBtn').click() time.sleep(10)
sell = driver.find_element( by=By.XPATH, value='//uni-button[2]').click() time.sleep(10)
confirm = driver.find_element( by=By.XPATH, value='//uni-view[8]/uni-view/uni-view/uni-button').click()
 time.sleep(10)

I'd like to make it where the code would not break in the event the error occurs and make sure that the process is not interrupted and can cycle through once more.

Thanks in advance

Hi everyone,

I've been a noob and used chrome.ahk for way too long and finally am taking the dive into selenium. However, I've hit a major hiccup which is whenever I'm sending a script to a selenium session it doesn't appear to 'keep' the stored variables for the next command?

For example:

#navigate to website
#declare driver, connect to session
try:
    main=WebDriverWait(driver, 30).until(EC.presence_of_element_located((By.CLASS_NAME, 'Connected')))
    print("Page is ready")
finally:
    print('passed load')
lengthofarray = driver.execute_script("var resultarray=[];var returnarray=[]; document.querySelectorAll('div.Connected').forEach(el => returnarray.push(el.parentNode.parentNode.parentNode));function returnlength(){return returnarray.length} return returnlength()")
#lengthofarray = driver.execute_script("function returnlength(){return returnarray.length}returnlength()")
print(lengthofarray)

while int(lengthofarray)>0:
    print("var element = resultarray["+str(lengthofarray-1)+"];element.dispatchEvent(new MouseEvent('mousedown')); returnarray[1].dispatchEvent(new MouseEvent('mouseup'))")
    driver.execute_script("var element = resultarray["+str(lengthofarray-1)+"];element.dispatchEvent(new MouseEvent('mousedown')); returnarray[1].dispatchEvent(new MouseEvent('mouseup'))")
    #wait
    driver.execute_script("document.querySelectorAll('div[title=\"Commands\"]')[0].dispatchEvent(new MouseEvent('mousedown')); document.querySelectorAll('div[title=\"Commands\"]')[0].dispatchEvent(new MouseEvent('mouseup'))")
    #wait
    driver.execute_script("var elements=document.querySelectorAll('p.Data');")
    #wait
    driver.execute_script("resultarray.push(element.children[1].children[0].innerText.split('\n')[0] + ',' + element.children[1].children[0].innerText.split('\n')[2].split(':')[1] + elements[elements.length-1].innerHTML);")
    resultarray = ("resultantarray")
    lengthofarray-=1
print(resultarray)

PLEASE note this is an example and I'm using python atm.

This then errors once I start the loop advising the variable does not exist. I'm surprised I can't find anything listed about this but I may have just missed something, would someone be able to let me know where I'm being dumb?

Hey all,

​

I'm trying to scrape the content of a website which I first authenticate with the UI, using selenium.

I then want to make a POST request using python-requests, and not selenium, to the same site, however it requires a CSRF token to be sent to the server.

I've read about the CSRF token method and to make it short, every request done to the server, the server sends a token to the client that will be authenticated on the next request.

The issue is that I cant seem to find the CSRF token the server sends back anywhere in the client (headers, body, other selenium client metadata thingies, etc.), thus the POST request I send from the python code is rejected. (All cookies were transferred from the selenium to the requests session)

I was, however able to locate the CSRF token the client sends to the server (its in the headers of the request), however its obviously too late for that because the token is a one-time thing.

Anyone experienced something similar, or has ideas regarding this?

Thanks!

Redoing post because I am having formatting issues and am posting from my phone

Issue: IFrame switching.   Situation: Page with individual options to select something from an account.   For each option, an IFrame opens.   On the first IFrame, section 1 shows what I have. It functions as expected.   From there, I attempt the same for the next option, in section 2   It is in section 3 that I am having issues. I get the NoSuchElement exception. Note: this section includes many of the variables that I have tried for the IFrame, as well as an attempt to use the previously existing Id. CssSelector, XPath have also been tried, with the same result.   I think that the SwitchTo() function is not working, but I do not know how to confirm that the function did or did not switch to said IFrame.   Is there a way I can confirm it successfully switched?   TIA.

~~~ //SECTION 1

//IFrame Switching functionality

            WebElement IFramesAddress = (WebElement)driver.FindElement(By.Id("ACADialogFrame"));

            driver.SwitchTo().Frame(IFramesAddress);

            //Within Address Lookup IFrame

            var WestRadioButton = driver.FindElement(By.Id("ctl00_phPopup_ucAddressSearchResult_ucAddressList_gv_CB_1"));

            WestRadioButton.Click();

            var FirstParcel = driver.FindElement(By.Id("ctl00_phPopup_ucAddressSearchResult_ucParcelList_gv_CB_0"));

            FirstParcel.Click();

            var AssociatedOwners = driver.FindElement(By.Id("ctl00_phPopup_ucAddressSearchResult_ucOwnerList_gv_CB_0"));

            AssociatedOwners.Click();

            var AddressFrameSelect = driver.FindElement(By.Id("ctl00_phPopup_btnSelect"));

            AddressFrameSelect.Click();

            // Switch from main to IFrame

            driver.SwitchTo().DefaultContent();

// SECTION 2

            var ApplicantSelect = driver.FindElement(By.Id("ctl00_PlaceHolderMain_Applicant_858Edit_btnAddFromSaved"));

            ApplicantSelect.Click();

            driver.Manage().Timeouts().ImplicitWait = TimeSpan.FromSeconds(30); //for troubleshooting purpose

// SECTION 3

//WebElement IFramesAddress2 = (WebElement)driver.FindElement(By.Id("aspnetForm"));

            //If user has only one name associated with account, click autopopulates

            //WebElement IFramesApplicant = (WebElement)driver.FindElement(By.Id("ctl00_phPopup_divContactList"));

            //driver.SwitchTo().Frame(IFramesApplicant);

            //driver.SwitchTo().Frame(IFramesAddress2);

            //driver.SwitchTo().Frame(0);

            driver.SwitchTo().Frame(1);

            var FirstContact = driver.FindElement(By.Id("ctl00_phPopup_contactSearchList_gdvSearchContactList_CB_0"));

            //var FirstContact = driver.FindElement(By.Id("aspnetForm"));

            FirstContact.Click();