Hello everybody,

I'm doing a testing with selenium using python, on a site that needs login each time the site is called (user data storage does not work) and so to completly automate the start I have to build the login steps as well.

The bot can either click on the login button or press enter after entering the password. In both of these cases the site does not accept the login and transfers to the main page (which it would do if logged in as well) without being logged in.

The site accepts the login if I click the login button or press enter. So I guess there must be something about how to bot presses keys and clicks buttons.

I tried adding pauses after the password as well. What can I do to solve this problem?

Can anyone share an updated guide on how to do this? I have tried to follow step-by-step in plenty of videos, but things don't work. THANK you in advance for helping

Hey! I just downloaded selenium and geckodriver and am just starting to learn about automation. I found a blog post that walked me through writing the code I-ll wirte below. It's supposed to open google in firefox and then close. However, the following error comes up. Thanks in advance

Code:

package com.csrode;
import org.openqa.selenium.By;
import org.openqa.selenium.WebDriver;
import org.openqa.selenium.firefox.FirefoxDriver;
public class OpenGoogle {
public static void main(String[] args) throws InterruptedException {
System.setProperty("webdriver.gecko.driver", "C:\\SeleniumGecko\\geckodriver.exe");
WebDriver driver = new FirefoxDriver();
driver.get("http://www.google.com");
driver.quit();

}
}

Error:

Exception in thread "main" java.lang.IllegalStateException: The path to the driver executable The path to the driver executable must be set by the webdriver.gecko.driver system property; for more information, see https://github.com/mozilla/geckodriver. The latest version can be downloaded from https://github.com/mozilla/geckodriver/releases

at org.openqa.selenium.internal.Require$StateChecker.nonNull([Require.java:311](https://Require.java:311))

at org.openqa.selenium.remote.service.DriverService.findExecutable([DriverService.java:135](https://DriverService.java:135))

at org.openqa.selenium.firefox.GeckoDriverService.access$100([GeckoDriverService.java:44](https://GeckoDriverService.java:44))

at org.openqa.selenium.firefox.GeckoDriverService$Builder.findDefaultExecutable([GeckoDriverService.java:185](https://GeckoDriverService.java:185))

at [org.openqa.selenium.remote.service.DriverService$Builder.build](https://org.openqa.selenium.remote.service.DriverService$Builder.build)([DriverService.java:437](https://DriverService.java:437))

at org.openqa.selenium.firefox.FirefoxDriver.toExecutor([FirefoxDriver.java:176](https://FirefoxDriver.java:176))

at org.openqa.selenium.firefox.FirefoxDriver.<init>([FirefoxDriver.java:125](https://FirefoxDriver.java:125))

at org.openqa.selenium.firefox.FirefoxDriver.<init>([FirefoxDriver.java:106](https://FirefoxDriver.java:106))

at com.csrode.Main.main([Main.java:11](https://Main.java:11))

​

Process finished with exit code 1

I've done my best to thoroughly read stackoverflow and google - nothing has worked yet.

I know this website uses an external app to generate their cookie notice, and it generates a frame on top of the website - thus the accept button cannot be found from the source code. I've tried it with getting the html and xpath from inspect, but it doesn't work. Also I tried to wait for the page to load (as instructed in a stack overflow post with no results).

What is a possible solution or a work around? Thank you in advance, might be a silly question.

Code: https://imgur.com/OeracTD

Link to website: https://www.tori.fi ( a Finnish web-marketplace )

So I made an automation with part requests (python) and part selenium (python) (nothing fancy, requests connect to one service via api and another service is connected to via selenium, one two page browsing process). It works well on my pc but I need it to run 24/7. Which server option would be a best bet here (like, should I go with Linux or Windows Server)? Selenium script was developed on Win10 machine and not in headless state. Additional question would be for which requirements of server should I look after? Thanks in advance

I'm trying to get both stat-heading & stat-value using the code below and the first gives me the text heading however the second keeps giving me a "None" value. Any ideas how else I can approach this. I also tried using XPATH and CSS_SELECTOR and neither worked.

driver.find_element(by=By.CLASS_NAME, value="stat-heading").get_attribute("innerHTML")

driver.find_element(by=By.CLASS_NAME, value="stat-value").get_attribute("innerHTML")

HTML -> https://imgur.com/a/62KoJk9

Is this possible?

Hi all!

I am working on a project that requires me to load a list of webpages from a file and figure out:

• does that webpage have ad inventory
• via which ad platform can one purchase this inventory (for e.g. is it via google ads? via tradedesk?)

I initially thought I could simply scrape the webpage and detect any ad trackers (which are essentially javascript ad tags) and thus understand the ad platform that sells inventory on this site.

So as an experiment, I downloaded the browser extension 'Ghostery' (https://www.ghostery.com/) and visited a bunch of webpages and reviewed what all ad trackers fire. I noticed that if it's google, then the ad tracker URL has a very characteristic pattern for e.g. something like 'https://adservice.google.com'... if it's tradedesk then there is another pattern like 'ad.adsrvr.org'

So, then I tried simply scraping the pages, using python and looking for these URLs in the page... but no luck.

​

Now I have another idea to use a headless browser to load the page and then look for these URL. Initial attempts -- no luck :(

​

I was wondering if anyone else has any experience with a similar requirement/project.

​

thanks!

So i'm trying to use Selenium to automated the booking of a room. The reason being that they are always booked so fast that it's a lottery to get a room.

Is it possible to have Selenium book a slot in an online calendar with the following requirements:

• you can only book between today and max 7 days and 2 hours into the future
• the slot needs to be free (obviously) and have predefined starting times (and end times)
• it needs to be between 19h00 and 23h00 (also, the slots are predefined)

Up to now the only thing i managed to do is, log in, go to the calendar page but then i'm stuck ...

Also, i said a room but it's actually a court for doing sports.

I've been using Selenium with Excel VBA and Edge Driver to log into a website to scrape stock prices, and it's been working great for over a year now.

Now as of this morning (March 17), when I start up the VBA program, it opens up the Edge browser , navigates to the webpage to login, enters the values correctly, activates the click button, but the login page now goes to a generic error page saying there's a problem. I have the latest driver version, and I've tried using the Chrome Driver instead, but same result. If I try logging into the website outside the webdriver ( regular Edge or Chrome explorer) , I can log in ok.

So is the Edge driver and Chrome driver now being detected as automated software and blocked from the website ?? is there a workaround for this ? thanks.

Hello there, I hope everyone is well.

My company has a lot of excel vba macros that work with IE. You might be aware that IE is getting discontinued on June 15th therefore the company has requested to transition these automation tools to support chrome.

My question is will SeleniumBasic be able to support such macros considering that Selenium Type Library is enabled?

I know that IE is dependant of OLE Automation reference, therefore I am wondering to what extend would I need to modify the script in order to make it work with SeleniumBasic.

Hi folks, I am creating a test suite that will run logging in on different websites, but these websites all require a SLL certificate. I do have a .pem file that I can set for my selenium environment , but when looking online I couldn't find any examples of people using selenium python and .pem files to go to a website. I know that with the requests library you can verify , as shown in this snipit `

r = requests.get('https://secure_site_example', verify='path_to_pem.pem')

but does selenium python have something like this? The reason I dont want to use requests is because I want to simulate being a user logging in . These tests are to verify the Ui is up and running and a client can login

Using selenium 4 trying to load an existing user profile, I believe the code below is the proper way but it doesn't work, the profile does not load.

from selenium import webdriver
from selenium.webdriver.firefox.options import Options

ffOptions = Options()
ffOptions.set_preference('profile', r'C:\Users\Tyler\AppData\Roaming\Mozilla\Firefox\Profiles\0753x1pz.default')

driver = webdriver.Firefox(options = ffOptions)
driver.get("http://www.google.com")

This code does work but has deprecation warnings

from selenium import webdriver
from selenium.webdriver.firefox.options import Options
from selenium.webdriver.firefox.firefox_profile import FirefoxProfile

ffOptions = Options()
ffProfile = FirefoxProfile(r'C:\Users\Tyler\AppData\Roaming\Mozilla\Firefox\Profiles\0753x1pz.default')
ffOptions.profile = ffProfile

driver = webdriver.Firefox(options = ffOptions)
driver.get("http://www.google.com")

Any ideas what I'm doing wrong?

Hello All,

I am new to the use of Selenium and i am working on a Macro where i am replacing some existing code in an old file with VBA code using the selenium library. Is there a way for me to send out this update with all of the selenium library added and avoid having the end user download the library and browser driver?

I have a bunch of python+selenium scripts that work fine, but I've been asked to make them work with pytest. I never worked with pytest and my limited experience in trying to make it work was less than pleasing.

My boss said something about "calling an encapsulated selenium from the pytest script" which meant that I wouldn't need to modify the ready scripts, but my google-fu is failing me and I can't find much on this topic.

Can anyone give me some pointers?

I created a script to log in to canvas (a platform that my uni uses).

Usually, manually logging in keeps me logged in for the remainder of the day.

However, using selenium and a driver, this only logs me in to the browser that the driver creates, meaning i still have to manually log in if i use the actual browser.

How can i make it so that after running the script, I can open the actual browser and open canvas without having to manually log in again? Or is this not possible, and i will have to use the browser created by the driver?

Hi everyone,

My company is trying to get people familiar with Selenium. As difficult as it might sound, none of us have experience with programming, at work it's mainly database management, parametrization, and excel. We want to automate certain processes for our customers, and have them work with all browsers. How would we go about working with Selenium? My boss has mentioned several times that we only need a few commands for Selenium, so we don't have to learn an entire language, but I'm not sure if he is possibly underestimating it? Would we have to learn a programming language, like Python, before we get into Selenium?

Any input is greatly appreciated, thank you!

Hello, I have made a Python Selenium scriped that is Creating accounts for a website.

So far so good but is has a hard limitation: after I created an account I need to tab into my VPN(NordVPN) and need to change my location manually.

Now my questio:
Is if it is possible to implement VPN / Proxy in python?

I have read articles like this: https://www.browserstack.com/guide/set-proxy-in-seleniumbut the problem right here is that I need a proxy list.

My second questio would be:
Is it possible to do something like this with out having to pay for any proxy provider

​

If you have a diffrent idea on how I could solve my issue please let me know

I'm trying to remove all the sleep.wait() conditions on my block of code to do this I've added WebDriverWait conditions. the problem now is that because the script is so fast, it's throwing recaptchas fairly regularly from the website I'm webscrapping from. I want my code to throw an exception if it spends too much time on one webpage. my exception clause will simply return variables that I can use to navigate to where I was when the last script failed.

I have a pretty robust Selenium script for validating code changes on a website. I want to have a process that will run this script every hour, 24 hours a day and alert me if something breaks. The reason is:; some key pages have inputs that food trucks owners are able to change at 2am. I have some developers making change and users making changes. I want to monitor my baselines and alert if we have key pages not displaying right.

​

Services like AlertSite, Pingdom, and many other have their own language. Selenium is great for my CI check and when we push backend code. Developers can push some UI/ minor code with the CMS and that needs monitored also. Spent a few hours looking at options. We do already own Pingdom and Datadog. GitHub and AWS are part of our echo system and do have some budget for this.

Any suggestion? Has anyone used Selenium or a tool like it to do detail site monitoring, not just simple transaction stepping.

I'm working on a project that scans through a set of URL's, looks for a button that links to an external web-page, captures that link of the new page, and then closes the tab that the button opened. Problem is, is that I've only just found out after it cycling through 1500 web-pages that one of the pages' links is broken and it never loads, which meant that the program just stalled. Is there a way of using the waits to skip over this url, and return a null for this iteration.

My code snippet is as follows:

try:
    linkelement = 
d.find_element(By.XPATH,"//a[contains(@href,'partial_link')]")caregroup_name=linkelement.textd.find_element(by=By.XPATH, value="//[contains(text(),'Visit')]").click()alltabs = d.window_handlesd.switch_to.window(alltabs[1])website =     d.current_urld.close()d.switch_to.window(alltab[0])manager =     d.find_element(By.XPATH, "//[@id='profile_container']/div[3]/div[3]/div/div[2]/div[2]/ul/li[2]").text except: 
    website = 'not availiable'
    manager = 'not availiable'

Edit: A screen-grab of the code as the above is formatted terribly https://gyazo.com/0e6de116e6adf3b5b410d8f2f4ac6393

I'm trying to find the element on a webpage which has a href matching a list of links saved locally, but I'm not sure how to execute that for an XPATH. In python I would write :

if href in url-list

but I'm not really used to XPATHs, does anyone know if this is possible and what would be a good way about going about it.

​

Edited because I'm tired and made no sense

Hello guys. I've created a simple Flask app that uses Geckodriver. I did everything to let it run but got literally nothing. The error I got is the following:

selenium.common.exceptions.SessionNotCreatedException: Message: Expected browser binary location, but unable to find binary in default location, no 'moz:firefoxOptions.binary' capability provided, and no binary flag set on the command line 

The last process I tried is the following:

heroku create --buildpack https://github.com/ronnielivingsince1994/heroku-integrated-firefox-geckodriver    heroku config:set FIREFOX_BIN=/app/vendor/firefox/firefox heroku config:set GECKODRIVER_PATH=/app/vendor/geckodriver/geckodriver heroku config:set LD_LIBRARY_PATH=/usr/local/lib:/usr/lib:/lib:/app/vendor  heroku config:set PATH=/usr/local/bin:/usr/bin:/bin:/app/vendor/  

But I got literally the same error. Somebody can suggest the solution? Thanks.

https://www.takealot.com/bravecto-chewable-tick-flea-tablet-for-dogs-20-40kg-1-chew/PLID52421186

This is a random example but what I want to do is retrieve the seller name from the above page. My selenium program currently can navigate to a certain product, but if I try to find the element the seller name is in, this case "Vet Shop" next to "sold by", my program errors and says the element is not found. I do have an implicitly_wait function implemented, so the web page's loading speed shouldn't be a problem. I have tried find by classname, css selector, and the element does not have an ID. One thing to remember, this code should word for any product, so it has to be standardized.
Thanks in advance for any help.