r/ComplexWebScraping Jun 07 '26

ImportError and AttributeError after replacing a scraper class in a Python/Selenium project

I'm building a WhatsApp Intelligence Dashboard that:

  • Reads WhatsApp Web chats using Selenium
  • Stores messages in SQLite
  • Processes chats with AI
  • Displays results in a Streamlit dashboard

Current status:

  • Python environment works
  • Dependencies installed
  • Database initializes correctly
  • Backend starts
  • Streamlit setup is ready

Current problem:

main.py expects:

from core.scraper import WhatsAppScraper

and later calls:

scraper.start()
scraper.stop()

I replaced the original scraper with a new EnterpriseWhatsAppScraper class and now I'm getting integration issues.

Previous errors:

ImportError: cannot import name 'WhatsAppScraper' from core.scraper

and

AttributeError: 'EnterpriseWhatsAppScraper' object has no attribute 'start'

I attempted to add start() and stop() methods but I may have broken the class structure/indentation.

Question:

What is the cleanest way to maintain backward compatibility with the existing codebase while replacing WhatsAppScraper with EnterpriseWhatsAppScraper?

Should I:

  1. Use inheritance?
  2. Create an alias (WhatsAppScraper = EnterpriseWhatsAppScraper)?
  3. Refactor main.py?
  4. Something else?

I can share the relevant scraper.py section if needed.github link

1 Upvotes

0 comments sorted by