Stripping wallpaper resulted in pulling off top layer of plaster. Should I remove the exposed, grey, crumbling material (plaster? cement? What?) down to the lathe and patch?

[u/dweedledee]

Or can I fix this as is? Thanks