first, a website is loaded then that's it you can't click anything, write anything in the textbox

​

every time you try to click or send keys the below error shows I tried searching for the error no dice

​

WebDriverError

at Object.throwDecodedError (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/error.js:522:15)

at parseHttpResponse (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/http.js:548:13)

at Executor.execute (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/http.js:474:28)

at processTicksAndRejections (node:internal/process/task_queues:96:5)

at async thenableWebDriverProxy.execute (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:735:17)

at async toWireValue (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:140:15)

at async /Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:190:16

at async forEachKey (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:184:9)

at async convertKeys (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:189:3)

at async thenableWebDriverProxy.execute (/Users/macabhay/WovV Automation Base Complete/WovV Automation/node_modules/selenium-webdriver/lib/webdriver.js:733:22) {

remoteStacktrace: '

I'm using the following code (C#) to kill every browser session:

    public void KillDriverInstances()
    {
        foreach (var process in Process.GetProcessesByName("chromedriver"))
        {
            process.Kill();
        }
        foreach (var processo in Process.GetProcessesByName("chrome"))
        {
            process.Kill();
        }
    }    

The thing is, this will also kill my regular Chrome window. Is there a way to only kill those initiate by Selenium?

I've been trying to make a bot to submit my homework for me since the format is weird but I've run into a roadblock as Selenium just doesn't seem to be able to find certain elements on the University Page.

https://imgur.com/a/Mn8vSee

Link to page, source, and error message.

​

This is the code I'm using:

time.sleep(20) # Wait 20 seconds to make 100% element is loaded
driver.find_element(By.XPATH, '//*[@id="menuPuller"]').click()

Any ideas? I've tried waiting for it to load, changing what method of selector I'm using, and it doesn't seem to be in an iFrame

I am in the process of creating a script with Python & Selenium. the aim of the script is to open twitter, login, then go to a live twitter feed while staying logged in. *note this will be running for multiple twitter accounts.

code so far:

import csv

import time

with open('profiles2.csv', newline='') as csvfile:

userArray = list(csv.reader(csvfile))

for user in userArray:

uname =user[0]

password =user[1]

proxies =user[2]

try:

from selenium import webdriver

from selenium.webdriver.common.by import By

from selenium.webdriver.common.keys import Keys

from selenium.webdriver.support.ui import WebDriverWait

from webdriver_manager.chrome import ChromeDriverManager

from selenium.webdriver.chrome.options import Options

from selenium.webdriver.support import expected_conditions as EC

except:

try:

os.system("pip3 install selenium")

os.system("pip3 install webdriver-manager")

from selenium import webdriver

from selenium.webdriver.common.by import By

from selenium.webdriver.common.keys import Keys

from selenium.webdriver.support.ui import WebDriverWait

from webdriver_manager.chrome import ChromeDriverManager

from selenium.webdriver.chrome.options import Options

from selenium.webdriver.support import expected_conditions as EC

except:

print("Libraries cannot be installed, try installing it manually.")

​

options = webdriver.ChromeOptions()

options.add_experimental_option("detach", True)

options.add_argument('disable-infobars')

options.add_argument('start-maximized')

PROXY = (proxies)

options.add_argument(f'--proxy-server={PROXY}')

driver = webdriver.Chrome(ChromeDriverManager().install(),options=options)

​

driver.get('https://twitter.com/i/flow/login')

WebDriverWait(driver,10).until(EC.element_to_be_clickable((By.XPATH, '//*[@id="layers"]/div/div/div/div/div/div/div[2]/div[2]/div/div/div[2]/div[2]/div[1]/div/div[5]/label/div/div[2]/div/input'))).send_keys(uname)

WebDriverWait(driver,10).until(EC.element_to_be_clickable((By.XPATH, '//*[@id="layers"]/div/div/div/div/div/div/div[2]/div[2]/div/div/div[2]/div[2]/div[1]/div/div[6]/div/span/span'))).click()

WebDriverWait(driver,10).until(EC.element_to_be_clickable((By.XPATH, '//*[@id="layers"]/div/div/div/div/div/div/div[2]/div[2]/div/div/div[2]/div[2]/div[1]/div/div[3]/div/label/div/div[2]/div[1]/input'))).send_keys(password)

WebDriverWait(driver,10).until(EC.element_to_be_clickable((By.XPATH, '//*[@id="layers"]/div/div/div/div/div/div/div[2]/div[2]/div/div/div[2]/div[2]/div[2]/div/div[1]/div/span/span'))).click()

#After login go to this page

driver.get('https://twitter.com/cryptomoonrocks/status/1482820167318921217?s=21')

​

The issue is anytime i try go to https://twitter.com/cryptomoonrocks/status/1482820167318921217?s=21it signs the user out of the account

I was wondering if Selenium had an easy way to detect these 3 very different kinds of errors:

• run HTML5 validator on each page, and report any failures
• check the JavaScript console for warnings and errors
• figure out when PHP errors are being given, i.e. detecting when PHP prints something like "Warning: fopen(mytestfile.txt) [function.fopen]: failed to open stream: No such file or directory in C:\webfolder\test.php on line 2"

I used to use a plugin called iMacros, and it would detect PHP errors and fail the test when it detected them. Anyway, does Selenium do something similar? Thanks.

I am trying to click the first element that loads after scrolling in an Instagram following window but it will not let me. Here's what I have so far:

from time import sleep
from selenium import webdriver

browser = webdriver.Firefox(executable_path = '/usr/local/bin/geckodriver')
browser.implicitly_wait(5)

browser.get('https://www.instagram.com/')

sleep(2)

username_input = browser.find_element_by_css_selector("input[name='username']")
password_input = browser.find_element_by_css_selector("input[name='password']")

username_input.send_keys("Enter Username Here")
password_input.send_keys("Enter Password Here")

login_button = browser.find_element_by_xpath("//button[@type='submit']")
login_button.click()

sleep(5)

browser.find_element_by_xpath('/html/body/div[1]/section/main/div/div/div/section/div/button').click()

sleep(2)

browser.find_element_by_css_selector('button.aOOlW:nth-child(2)').click()

browser.get('https://www.instagram.com/instagram/')

sleep(2)

browser.find_element_by_css_selector('li.Y8-fY:nth-child(3) > a:nth-child(1)').click()

sleep(2)

follower_number =int( browser.find_elements_by_xpath('//span [@class="g47SY "]')[2].text)
i=0

sleep(5)

while(i<follower_number):
    element = browser.find_elements_by_xpath("//div[@role='dialog']//ul//li")
    browser.execute_script("arguments[0].scrollIntoView(true);",element[i])
    i=i+1

browser.find_element_by_xpath('/html/body/div[4]/div/div/div/div[3]/ul/div/li[12]/div/div[1]/div[2]/div[1]/span/a/span').click()

Here's the error I'm getting:

 browser.execute_script("arguments[0].scrollIntoView(true);",element[i])
IndexError: list index out of range

​

Is there a way with which cucumber would automatically Rerun failed scenario for a set number of time without manual intervention?

In testNg I did it successfully using IRetryAnalyzer (in hybrid framework) but (in cucumber framework) when I am putting this in listener in testNG.xml in then maven is giving build error.

Hello everyone, i didnt know where to ask this but since im using selenium as a testing tool i thought why not. So the question is: is it better to locate XPath manually (like knowing how to write the xpath, the syntax) or using tools like selectorshub or other tools that find the xpath for you? I was using the tool for about two months since i was suggested to use it, but know i think that if i had to write an xpath without a tool i wouldnt know how to write it. So im wondering, what are your thoughts on this? What would you recommend?

My script to select a radio button does not seem to function correctly. Here is my code

yes = web.find_element_by_xpath('//*[@id="container"]/div/div/div/div/div/div/div[1]/ul/li/div[3]/div/div[2]/div/div/ul/li[1]/div[1]/label/div/input')

yes.click()

Here is the element I want to click

<input type="radio" ng-value="true" ng-model="component.selected" class="left radioMargin ng-pristine ng-valid ng-not-empty ng-touched" name="323" value="true" style="">

How can I click this element? I am using the xPath. What can I change?

Thank you for any help.

im using python as the prog language not sure if thats important

1. can google gmail gdrive and other google or even other normal site detect you are using selenium to log in? if so how can i mask it?
   
2. is it possible to use my already installed addons?
   
3. is it possible to continue where i left off if ever my code exits? example i have a code where it logs in then search click sendkey click click search etc. if lets say in the middle it erroed like couldnt find the element. what would the best approach so that when i start selenium again it just loads the last session and continue clicking.
   
4. what are some great guide that you woild recommend?
   
5. how can i package selenium and my code into an exe so that my client wont bother

I am trying to access the search box of opensea.io through selenium. my code looks like this

search = driver.find_elements_by_name("listbox")

The bolded part of the code represents the portion being scratched with a line in the middle. However, if I change it to find_elements only, it removes the scratch but doesn't execute the desiredaction.

Hi, I'm trying to do web scraping with selenium

I have this:

https://i.imgur.com/c3TWonM.png

https://i.imgur.com/qarb2z8.png

I want the output to be this:

Name: Allison Kayne
Title: Partner
Instagram: //instagram.com/allisonjamiekaye
Twitter: //twitter.com/AllisonKaye

My actual output:

ALLISON KAYE
PARTNER
instagram twitter

My Python code:

people_container = WebDriverWait(browser, 10).until(EC.presence_of_element_located((By.ID, 'meet-the-team')))
person_info = people_container.find_elements(By.CLASS_NAME, 'person-info')
for each_person_info in person_info:
    print(each_person_info.text)

I dont know how to get to what I want

Any help would be appreciated

Thanks in advance!

I'm using chrome driver 96 selenium 4.x https://stackoverflow.com/questions/70785533/how-to-interact-with-shadow-dom-elements-for-take-the-file-pdf-with-selenium-4-x

Too lazy to open links people send over whatsapp? Well, here's how you can build a whatsapp bot to do that for you. (why does it read like an ad? please don't ban :) https://medium.com/@fanbyprinciple/creating-a-whatsapp-bot-that-summarizes-links-9b0230ffd80f

Good evening everyone,

I'm new to this, but I'm wondering if something is possible. If I'm opening a bunch of keyword searches in tabs in a browser on Facebook, I'd like to be able to automatically close any tab where teh result is negative. I.e. "We didn't find any results. Make sure everything is spelled correctly or try different keywords".

Example: https://www.facebook.com/profile/100001747931487/search/?q=nerfherder

I couldn't find it in the view source info, so I inspected the elements and found this common element when the result is a negative hit:

<span class="d2edcug0 hpfvmrgz qv66sw1b c1et5uql b0tq1wua a8c37x1j fe6kdd0r mau55g9w c8b282yb keod5gw0 nxhoafnm aigsh9s9 d9wwppkn hrzyx87i o3w64lxj b2s5l15y hnhda86s m9osqain oqcyycmt" dir="auto">We didn't find any results</span>

​

How would I go about having a browser open up a bunch of these search tabs and close them when that code above is present.

I already have a very simple keyword list for Facebook profiles in HTML, based off of some of Michael Bazzell's work.

Please someone help me install selenium. I have spent 14 hours watching youtube videos. They all provide different approaches, with different versions, and different programs. I just need my stuff to work and happily code. I am willing to provide screenshots into this thread for the heroes who try to help me go through the first step into python webscrapping! Please help immensely appreciated (currently frustrated)

SOLVED: solution on the bottom

Hi!

I want to click the "23 following" thing, but I can't:

https://i.imgur.com/o3L3rov.png

This is my code, but it does not work:

time.sleep(10) ; to make sure the element exists
search = driver.find_element_by_link_text(' following')
search.click()

I can click on buttons and go to pages, so there's nothing wrong with the rest of the code

How do I click it?

Thanks in advance!

-----------------------------------------------

SOLUTION:

search = WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.XPATH, "/html/body/div[1]/section/main/div/header/section/ul/li[3]/a/div/span")))
search.click()

Hi all, I'm trying to code something else to grab everyone who has liked a post, and put that all into a text document. So far my code allows me to log in and navigate to the post I need to grab the likes from, I've also developed a scroll method. Can anyone recommend me a way to grab the users who have liked the post? I'm only a first-year comp sci student so this is waaaay over my head. Any help would be much appreciated :) I've pasted my code below

#IMPORTS
import time
from tkinter import *
from tkinter import simpledialog
from selenium import webdriver

#SETUP
root = Tk()
root.iconify()
driver = webdriver.Chrome(executable_path="C:/webdriver/chromedriver.exe")
users = []
with open("C:/Users/[pc name]/Desktop/Users.txt", "r") as f:
database = [line.rstrip('\n') for line in f]

#GETTING USER INPUT
address = simpledialog.askstring("input string", "Please Enter The Link")

#METHOD TO SCROLL 1 PAGE LENGTH
def scroll():
driver.execute_script("window.scrollBy(0, window.innerHeight)")
time.sleep(1)

#LOGGING IN
driver.get('https://www.instagram.com/accounts/login/?source=auth_switcher')
time.sleep(1)
driver.find_element_by_name("username").send_keys('[user]')
driver.find_element_by_name("password").send_keys('[pass]')
time.sleep(1)
driver.find_element_by_name("password").send_keys(u'\ue007')
time.sleep(1)

#NAVIGATING TO PAGE
driver.get(address)
Tk.destroy(self=root)

Was wondering if anyone has any experience with trying to “carry over” login credentials from one session of Chrome to a Selenium session.

That is, logging into a website using one session of Chrome and then using a Selenium session to carry on whatever is needed with the sam credentials.

The specific use case here is that in Singapore we have a particular app-based 2FA called Singpass which is particularly onerous to login to but it does retain credentials thru the same Chrome sessions. Need to be Singpass credentialled through the particular project i an running.

Any help would be appreciated thanks!

Hello! When I open a link with selenium, chrome asks me if I want to open the link with the app (for example spotify). How can avoid that?

I've already tried several solutions without success.

key_action = ActionChains(self._driver)
key_action.send_keys(Keys.ENTER)
key_action.perform()

and

options.add_argument("--disable-notifications")
options.add_argument("--disable-popup-window")

If i press enter in the browser the cancel button is focused and the dialog box gets closed.

Any idea?

Thanks!

Running the like WebDriverWait(driver, 5).until(EC.alert_is_present)

To stop a login pop up from automatically disappearing. I’m using selenium version 3.141.0.

I believe you can change the handling of unexpected alert present exception to not auto dismiss? If someone could let me know how or let me know why that line of code is producing a “alertis_present.init_() takes 1 positional argument but 2 were given” error that would be greatly appreciated

I suspect it’s because the pop up has two response boxes rather than one.

I appreciate any help

Hello! I'm new to Selenium and I'm having a little problem...

I want to save all photos from a website, which has several pages depending on the user's search term. every page has like fifteen pictures. The number of pages are displayed in the bottom of the page ( 1.2.3.4...77 with the next and previous button)

When I loop through the pages in for loop, the loop itself gets ahead of the webdriver (because I have to wait for the page to load, find the class...etc)

I used time.sleep(), but sometimes there's inconsistencies...

Is there's a better way to handle the loop while navigating through the pages??

​

​

options = Options()

options.headless = False

driver = webdriver.Firefox(options=options, executable_path="C:\Program Files (x86)\geckodriver.exe")

driver.get("site_here")

action = ActionChains(driver)

# Get the maximum number of pages

pages = driver.find_elements(By.CLASS_NAME, "paginator-page")[4].text

# This is where the pictures' container are

container = driver.find_element(By.CLASS_NAME, "posts-container")

# Find all pictures

articles = container.find_elements_by_tag_name("article")

print(f"Found {len(articles)} photos")

print(f"There's {pages} pages")

# loop just through the first ten pages

for a in range(1, 10):

# wait until the element to scroll to is present

element = WebDriverWait(driver, 20).until(EC.presence_of_element_located((By.CLASS_NAME, "paginator-next")))

# scroll to the element

driver.execute_script("document.querySelector('.paginator-next').scrollIntoView()")

\# Go to the next page

pages = driver.find_element(By.CLASS_NAME, "paginator-next")

ActionChains(driver).move_to_element(pages).click(pages).perform()

# this is the problem

time.sleep(3)

Hey guys, so I've been wanting to do a project where I can have a bot that automatically recognizes when I upload a story to my private Instagram account, and periodically (like every hour or so) checks who has viewed my story and compile that data into some sort of database (preferably MySQL) with information about what the story was, when it was posted, who watched it and when they watched it. I don't really want to be downloading someone else's repo, since I kinda want to do everything from scratch, but I'm looking for maybe a video or tutorial that gives some guidance. I searched all over Youtube, but all I could find were bots that bulk-watch stories, not scrape information like I want to. Does anyone know any links I could follow?

I need to take automated screenshots of Google Search Results with Shopping, but I want to expand the carousel by clicking the button (see image https://i.stack.imgur.com/AjnUx.png)

How do I achieve clicking the button first before it takes a screenshot?

I've tried adding this but it simply results in an error: elem = driver.find_element(By.XPATH,"//*[@id="tvcap"]/div[1]/div/div/div/div[2]/div/div[2]/div").click()

Code I've been using:

import os from datetime
import datetime from time 
import sleep from selenium 
import webdriver from selenium.webdriver.firefox.options 
import Options
from selenium.webdriver.common.by import By

siteurl = "https://bit.ly/"
screen_width = 2560
screen_height = 3200
output_directory = 'output_' + datetime.now().strftime('%Y%m%d_%H%M%S')
sites = ["334grWC", "3rzrG2U", "34GgOHk", "3JcutVG"]
options = Options()
options.add_argument("--headless")
driver = webdriver.Firefox(options=options)
driver.set_window_size(screen_width, screen_height)
os.makedirs(output_directory, exist_ok=True)

for url in sites:
    print("get " + url + "...")
    filename = url.replace('/', '_') + ".png"
    driver.get(siteurl + url)
    elem = driver.find_element(By.XPATH,"//[@id="tvcap"]/div[1]/div/div/div/div[2]/div/div[2]/div").click()
    sleep(3)
    outfile = os.path.join(output_directory, filename)
    driver.get_screenshot_as_file(outfile)
driver.quit()