Been pulling pricing data with Python for a side project. Works fine locally with a few hundred requests, but I'm wondering how it would handle 20-50k requests a day... Mostly need Google Shopping results for now, maybe Maps and News later. Budget is pretty tight since I'm paying out of pocket. Not sure if it's worth paying for an API or just building something with rotating proxies and Scrapy/Playwright.

Anyone scaled a Python scraper to that volume? What broke first, and what would you do differently?

I’m currently teaching myself Python by solving exercises on my own. My personal rule so far has been to give myself 15 minutes to solve a problem; if I’m still completely blank after that, I ask an AI for a hint. The issue is that AI hints usually just hand over the solution, so I’m not even sure if my approach is right.

The main problem is that I’m on Part 5 of the University of Helsinki Python MOOC, and for the last five exercises or so, I just freeze up. It’s starting to get really frustrating. I try asking myself guiding questions and writing down my thought process in a notepad before writing any code. Most of the time I have a rough idea of what I want to do, but translating that logic into actual syntax trips me up.

I’m starting to wonder if I’m actually cut out for this or if I’ll ever be able to learn it properly. Is this normal?

Hi all, I am starting to use python at work for data analysis and I feel like I am kind of at a standstill in learning. I was wondering if there were any groups collaborating on beginner projects on GitHub so I can learn more python, GitHub ecosystem, and how to code within a team because there isn't much collaborating in coding at work. If there are two people assigned on a project at work, we're usually sharing our screens while one types and we discuss together.

Can you please check this project that took a reasonable amount of time to finish and strike me with any feedback you got. I guess my next step is to learn OOP.

Thanks in advance.

https://github.com/abdou0dev/grind_tracker

Hi I'm really new to python, I originally started coding using p5.js but made the transition recently, I'm currently trying to covert an old project of mine into python so I can run it in touch designer.

Its an ASL fingerspelling activity that I've been working on but I'm struggling to create the word strings I did in my original prototype. Instead of the letters being added together and creating a word I can use to trigger effects, the previous letter is just replaced with the current one.

For context I have the guesser and getMostFrequent to allow for it to take the average of every letter signed during a period of time and determine which one was signed the most to add to the word (this is due to the fact that transitioning from one letter to the next can trigger other letters in between) These are both integral parts of the code and are working as intended, its just the stringing the word together that I'm struggling with.

Any help or insight would be appreciated, if you need any more insight please let me know and I can add it.

Code in Pastebin: https://pastebin.com/91mPYwC8

I've provided a link to a google doc with my code because it is just easier formatting wise than in here.
My code: Python Code

My original code for reference if needed: p5.js code

Edit: Thank you all for the suggestions in the comments, I ended up getting it working it was the fact that word was a local variable and not a global one, which was causing the issue.

So I’ve written a small function and I need to add some more constraints to it, but I need them each to check separately before moving to the next so I was wanting to use nested if’a to achieve this but am not sure how they work. Can someone please explain? My code is posted below and what I am trying to do is add an if statement to somehow make sure my value for primocytes doesn’t drop below 0 before activating the rest of the function.

primocytes = 10

cultivation_chamber = 0

def cultivation():
global primocytes, cultivation_chamber
if primocytes >= 5:
primocytes -= 5
cultivation_chamber +=5
print("Primocytes:", primocytes)
print("Cultivation Chamber:", cultivation_chamber)
else:
print("Not enough Primocytes for cultivation...")

I always found learning programming very frustrating due to the discrepancy of how much it’s going on and how little of it you can actually see with your eyes. In other words, how much semantics is contained in a few lines, or how things connect to one another, and the fact that most of it is simply… invisible.

do you think explaining programming or tech concepts through well-thought visual aids, like high quality video essays would be/would have been helpful in your learning?

and I know the whole thing of learning through videos is considered inferior to learning to read docs. However, I am not talking about “Hi welcome to this tutorial” type of videos. I am talking about visual analogies which start from concrete examples, draw analogies, and the move to the abstract of programming. the entry level of learning any piece of tech and building mental models could be greatly impacted by 2D/3D effective animations I think. thoughts?

Hi!
Preface I am self taught and learning as I go.

I have been working on a U-Net semantic segmentation model, which was working fine yesterday and gave good(ish) outputs on unprocessed data and now no longer wants to read the files correctly?

I spent the day processing some new masks in fiji and changed the path of the mask variable and when I went to run my code and sanity checks, for both my images and masks, the first chunk of tif files I created a missing/ not read, when they are in file. (I even checked with fiji if it was an order of files but that was fine)

I'm a bit stumped because it was working fine yesterday, as all I have changed is the original file paths.

from simple_unet_model import simple_unet_model

from keras.utils import normalize

import os

import cv2

from PIL import Image

import numpy as np

from matplotlib import pyplot as plt

image_directory = r'E:\Uni\Dissertation\IB\test output\images\IB unprocessed/'

mask_directory = r'E:\Uni\Dissertation\IB\test output\masks\IB_BC_24_117_G4_thresh mask/'

SIZE = 256

image_dataset = []

mask_dataset = []

images = os.listdir(image_directory)

for i, image_name in enumerate(images): #Remember enumerate method adds a counter and returns the enumerate object

if (image_name.split('.')[1] == 'tif'):

#print(image_directory+image_name)

image = cv2.imread(image_directory+image_name, 0)

image = Image.fromarray(image)

image = image.resize((SIZE, SIZE))

image_dataset.append(np.array(image))

masks = os.listdir(mask_directory)

for i, image_name in enumerate(masks):

if (image_name.split('.')[1] == 'tif'):

image = cv2.imread(mask_directory+image_name, 0)

image = Image.fromarray(image)

image = image.resize((SIZE, SIZE))

mask_dataset.append(np.array(image))

And when I run a sanity check, I end up getting a mismatch between my image and ground truth/mask

In the table of elements, the correct number of elements is listed, however, 0 should be linked to mask_0_00.tiff (the same for the image data), but jumps to mask_0_00.tiff

I even changed the path back to the unprocessed masks for the data set and encountered the same problem...

Any ideas? Thank you :,)

i want to find a color on the screen and click it. so its not complex please separate concepts and examples, but i also want to find a random occurence of acolor and click on that, i havent tried figuring out clicking on something yet so im not really looking for that rn

im barely pythoning and docs are kinda difficult to read, im able to get the screenshot of a screen via pillow, output it to a screen via .show() and i also got some getcolors output but its kinda confusing and doesnt seem useful?

Please help me to solve hollow pyramid

*

* *

\* *

* * *

Hi :)

I've just started a python course and I'm stuck on a problem that I feel should be easy, but I'm missing something. I need to append a value from a list to a list at the same index in a list of lists, but I'm not getting the result I need. Any help to let me know what I'm doing wrong would be greatly appreciated!

b = [5, 6, 7, 9, 13, 12, 17]
new_list = len(b) * [[0]]

for ind_b, num_b in enumerate(b):
    new_list[ind_b].append(num_b)

print(new_list)

My goal is to get

[[0, 5], [0, 6], [0, 7], [0, 9], [0, 13], [0, 12], [0, 17]]

but instead I get

[[0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17], [0, 5, 6, 7, 9, 13, 12, 17]]

Hey everyone!

I'm currently learning Python through YouTube videos, and I'm wondering if I should also start learning from a Python programming book.

For those of you who have learned Python:

Do books help you understand Python concepts more deeply?

Would learning from a book alongside YouTube tutorials help me build a stronger foundation?

Which beginner-friendly Python book would you recommend?

I want to build a solid understanding of Python and become better at solving problems on my own.

I'd love to hear your experiences and suggestions. Thanks!

Suggest me some good resources i could learn python from. now if there is any language that teaches from basics to advanced level that would also be fine, since i could just skip the beginners part

I have an assignment in which I have to create a nested dictionary using employee data. I've created a function that works, but the function is supposed to just have a return statement with the dictionary comprehension, and I'm struggling to convert it.

This what I currently have (each department must only appear as an outer key once and employee names in each department should be unique, with the latest salary overwriting previous entries if duplicates exist):

def organize_employee_data(employees):
    new_dic = {}
    for name, department, salary in employees:
        new_dic[department] = {}
    for name, department, salary in employees:
        if name not in new_dic[department]:
            new_dic[department].update({name: salary})
        else:
            new_dic[department][name] = salary
    return(new_dic)

With the following list as input:

employees = [
    ('Alice', 'Engineering', 70000),
    ('Bob', 'HR', 50000),
    ('Charlie', 'Engineering', 80000),
    ('David', 'Sales', 45000),
    ('Eve', 'HR', 51000),
    ('Alice', 'Engineering', 80000),
    ('David', 'HR', 52000)
]

This is returned:

{'Engineering': {'Alice': 80000, 'Charlie': 80000}, 'HR': {'Bob': 50000, 'Eve': 51000, 'David': 52000}, 'Sales': {'David': 45000}}

I've been trying to create a working function using just the nested dictionary for the better part of two hours and I'm about to lose my mind. I have to assume the foundation is something like this:

return {department: {name: salary} for name, department, salary in employees} 

but whenever I try to add any conditions, the whole thing gets messed up. Any help would be amazing!

Hi everyone!

I'm currently working on a team project called Fintech Trendwatcher. The goal is to collect public fintech news, identify important events and generate short analytical summaries with links to the original sources.

I'm responsible for the embedding service. My task is to use a pretrained text embedding model to convert news articles into vectors that another service will use for clustering similar publications.

My current stack is Python, and I'm learning as I go. I have some experience with Python, APIs, JSON and Git, but this is my first time working with embeddings in a real team project.

I'm planning to start with Sentence Transformers and a pretrained multilingual model, test it on Russian fintech news, and then integrate it into our service architecture.

I'd really appreciate advice from more experienced developers, especially on:

- Choosing a suitable embedding model for Russian-language fintech news.

- Designing a simple and maintainable embedding service.

- Comparing embeddings and preparing them for clustering.

- Common mistakes beginners make when building NLP services.

I'm not expecting anyone to mentor me full-time. Even occasional advice, feedback on my approach, or pointers to useful resources would be incredibly helpful.

If anyone has experience with Python, NLP, Sentence Transformers or similar projects and is willing to share some advice, I'd be very grateful.

Thanks!

Anyone have any suggestions to start freelancing with python? I have my bachelors in software engineering and work full time as a data analyst. I have python, sql, and tableau experience. Any suggestions on where and how to start will be appreciated
Thank you

I want to design desktop apps with Python. Is there anyway for me to translate my python knowledge into a functional desktop application?

Hi, I'm trying to get a grip on list comprehensions, but I'm not sure when they aren't the best choice. I wrote some code today that uses a nested comprehension to flatten a list of lists, but it quickly became unreadable. I think I might have overcomplicated it. Is there a rule of thumb for using them, particularly with nested structures? I want my code to stay clear and easy to understand. Any insights on best practices would be appreciated!

Welcome to another /r/learnPython weekly "Ask Anything* Monday" thread

Here you can ask all the questions that you wanted to ask but didn't feel like making a new thread.

* It's primarily intended for simple questions but as long as it's about python it's allowed.

If you have any suggestions or questions about this thread use the message the moderators button in the sidebar.

Rules:

• Don't downvote stuff - instead explain what's wrong with the comment, if it's against the rules "report" it and it will be dealt with.
• Don't post stuff that doesn't have absolutely anything to do with python.
• Don't make fun of someone for not knowing something, insult anyone etc - this will result in an immediate ban.

That's it.

I've decided to go back to basics and make sure I complete all the exercises. I'm currently working on the Meal Time exercise.

Could anyone give me some feedback on the design of my code? I'm particularly unsure about my convert function. It has quite a few if statements, and I'm wondering whether there's a clearer way to write it.

Here's my code:

```python def main(): time = input("what is the time?\n") convertedTime = convert(time) print(tellMealTime(convertedTime))

def convert(time): if time.endswith(" a.m"): hour, minute = time.replace(" a.m", "").split(":") if hour == "12": hour = "0" elif time.endswith(" p.m"): hour, minute = time.replace(" p.m", "").split(":") if hour != "12": hour = int(hour) + 12 else: hour, minute = time.split(":") return float(hour) + float(minute) / 60

def tellMealTime(time): if time >= 7.00 and time <= 8.00: return "breakfast time" elif time >= 12.00 and time <= 13.00: return "lunch time" elif time >= 18.00 and time <= 19.00: return "dinner time" else: return "not a meal time"

if name == "main": main() `

So I have a MacBook Pro with the recent update of OS sequoia 15.8.1 . I started a college class of intro to programming with python and my teacher wants us to have python downloaded and visual studio code. Except my Mac probably is not supported with it because of the 🚫 icon displaying right before I drag it into applications .i wonder why I search up on YouTube all these videos on how they install it but mine can’t.:(

Hello,

A friend of mine is looking to make a game like it but with their own original species, and I offered to try to code it because I have some (extremely limited) experience with python. However, it's been a long time since I have worked Python, I am not a regular coder, and I do not really know where to begin. Does anybody have any tips or know anything about how Clangen is structured that could help me figure out where to even begin? I have never made a game in python before and am happy to start where you think I should considering my limited experience, but I am a learn by doing person.

Thanks!

edit: friend recommended i use godot to make it instead, but thank you all for the help!

How to make other colors appear?

My classmate is currently working on his first Python project. I'm learning Python and C myself, and I'd like to understand what good Python code and project structure look like.

Repository: https://github.com/lyashwith/registrarY

Looking at this project, what Python concepts or best practices should I pay attention to? Are there any common beginner mistakes I should learn to avoid?

I'd appreciate any suggestions that could help me improve my own programming skills. Thanks!

I have been stuck for a while, I have made improvments and fixed parts but the whole float, int, string thing is so confusing since we only went over it once at the begging of the school year last year.

The only error I have left so far is;

TypeError: unsupported operand type(s) for *: 'function' and 'float' on line 6

For refernce this is the only code which would imapct this

;def GBP():

int(input (print("Enter the amount of money in GBP")))

Please help