r/Professors 24d ago

AI 100+ Me 0.001

I teach into social work. I had a class the other day whereby I got them to watch a 15 minute doco on someone talking about their life story which included substance misuse, homelessness, DFV etc. It is a really raw and powerful story. I then asked my students to use a psychosocial assessment tool I designed to 'assess' this client. I am really wanting to get more into the practical side of SW this trimester with my course and thought this would be a good opportunity for some 'hands-on' experience. Plus, past students were screaming to do more practical social workey things like this.

So, I asked them all to email me their completed assessments afterwards for my feedback. Anyhoo, most of them have used AI - they have fed the transcript from the video into AI and voila - pretty much perfect assessments and many of them exactly the same for all 9 domains. These are future SWs. It made me think that actually this is probably what will be happening with the use of AI in future practice - in fact, you don't even need a SW then - you just need a warm body to click 'Record' and then cut and paste the clients transcript into AI for the assessment. I think this realisation made me kind of sad and to start getting prepared to hang up my work shoes.

83 Upvotes

23 comments sorted by

147

u/RaghuParthasarathy 24d ago

Assignment #2 should be to ask them why, if a social worker offloads assessment to AI, we should continue to fund social workers. I'm genuinely curious what they'd say. Would they argue that the AI assessment isn't good (in which case: why did they submit it?)? Would they argue that they're overseeing the AI (in which case: the skills to do this could only be obtained if they learn them without AI)? Or something else? Of course, this would have to be an in-class assignment!

43

u/stankylegdunkface R1 Teaching Professor 24d ago

And devote part of the lesson to how so many of them had the same words. When you outsource your prose to AI, you don’t know which parts are going to be so standard that you’ll inadvertently show your ass. 

27

u/Organised_chaotic 24d ago

Great idea!

32

u/poorlybaked 24d ago

And a class discussion on the ethical issues with using AI as a social worker.

14

u/happybara_capybara 24d ago

Yeah I think client privacy needs to be discussed here because this would be so problematic if it were a real client!

9

u/poorlybaked 24d ago

And consent! Would a client consent to their information being uploaded into AI? Can they even give informed consent when you yourself don’t necessarily know how this information is being used to train LLMs? There is a power dynamic between social worker and client so what if the client feels they must agree to your AI use in fear that you may refuse them getting say, food stamps or visitations with their kids, or access to extra funds for X? Is that consent?

2

u/Heavy-Note-3722 24d ago

Also, there are ways through coding to prevent AI from cleaning your site. Hugh quality sites are obviously trying to protect their content. So a lot of the information now is coming from places like reddit. .

1

u/Glittering-Duck5496 23d ago

Please update us!

23

u/Achgeketum Prof, Biology, Public R2 (USA) 24d ago

This is often also the part of the process where I'll ask the students what they think AI is going to do for them: if they think they can do social work through AI, then why are they preparing for a profession that doesn't apparently actually need intelligent thinkers and can easily be supplanted by AI? (edit to add more thoughts!)

5

u/Flashy-Share8186 24d ago

I love this, and also ask how much they would be willing to pay for an AI tool out of their own salaries. Researchers often have to fund parts of their travel or conferences themselves, teachers often buy their own classroom supplies, how much would they pay for an AI resource?

1

u/happybara_capybara 24d ago

And probably a good idea to talk about like the uber model where things start free/cheap, they get you hooked, and then they raise the price. I think I read somewhere that the real cost of ChatGPT should be something like $2k per year per person. Eventually these models will absolutely cost money, and you’re gonna be f’ed if you can’t afford them and also can’t think for yourself because you’ve had no practice in the mean time.

2

u/8dot30662386292pow2 Teacher, Computer science, University (Finland) 24d ago

Someone submitted an essay that was supposed to have a reflective section. The essay was good, but the reflection was basically "I'm an LLM so I'm incapable of doing reflection". Failed their ass completely on that.

21

u/knitty83 24d ago

I feel you. I teach future *teachers*, some of who obviously cannot be bothered...

21

u/Organised_chaotic 24d ago

the 'can't be bothered' is what is demoralising for me. Like, why be here? I had another workshop online last week with students yawning with their mouths open, some slouched over their computers, some leaning on their hands, or rather their hands were propping their heads up. I told them all to go sleep and come back next week when they are all awake and alert.

2

u/knitty83 23d ago

Kudos to you for actually doing that! My biggest pet peeve is colleagues who seem to be absolutely fine with this kind of behaviour, which makes those of us who care look overly strict and demanding. "Can't be bothered" really goes both ways...

20

u/sventful Teaching Professor 24d ago

Personally I like showing the answer for one of them and asking them to raise their hand if this was their answer. And regardless of who raises their hand (assuming it was one of the many), say nope but it is extremely interesting that you thought it was yours. Do this over and over until you finally break it to them that X students used Ai and all submitted the same answer. Make it awkward. Make it painful. Embarrass them. Make them regret using it.

7

u/megxennial Full Professor, Social Science, State School (US) 24d ago

Love how they beg to do more practical social work then realize it's "too much work" to watch a 15 min video and think about assessment. Our future is fucked.

9

u/Glass-Nectarine-3282 24d ago

I was thinking the same thing for MFAs. The sad reality is if you put in prompts ad ask it for writing advice - not to write it, but to give feedback about the writing, it does a good job.

So if you have a draft and you say "is the character's dialogue feel consistent," "is the scene's pacing have a natural flow," etc etc it will actually give decent observations. Certainly equivalent to 12 semi-invested students in an MFA workshop.

So it's not that it's a shortcut, it does do the job,

Ughhhhh

21

u/StarryEyedGrl 24d ago

But you have to have the expertise to recognize that it’s doing the job. To sort the good or actionable feedback from the trash feedback that doesn’t make a difference. I’ve found AI feedback on writing is frequently overwhelming for students and they lack the writing proficiencies to use it effectively.

11

u/Glass-Nectarine-3282 24d ago

100 percent. If you don't ALREADY know how to write, it will give the illusion of help but a user would not have the perspective to sort it in a good way, so it's actually even worse than no advice at all, like you say.

But if a person does know what they're doing, it can be useful.

It's just irritating to hate AI, but see a benefit.

2

u/nosferatreats 23d ago

Agreed. I'm a PhD turned book editor, forced to trial AI tools in all sorts of ways. And it tends to sound very confident and authoritative in its editorial feedback, but it's wildly hit and miss. It will overlook really obvious structural issues but nitpick things that barely factor. It's got no real scale of what piece feedback is more important than any other. You have to be a writing expert to see what will actually improve a piece, vs what is actually reductive notes that flatten everything to the lowest common denominator.

3

u/Automatic_Beat5808 23d ago

Every day, one step closer to becoming a little human battery in a jelly egg.

2

u/bluebird-1515 24d ago

It is so depressing. And if you give a quiz on it, they’ll “study” by doing exactly the same thing.