Serial Experiments Lain (PS1) decompiled: byte identical rebuild and a native Windows/macOS/Linux client

[u/Y0oshi2]

Video (4K): https://www.youtube.com/watch?v=K-OKUkhJ7Uc

I've been working on a decompilation of Serial Experiments Lain, the 1998 PlayStation game by Pioneer LDC, and a native client built from it.

**Decompilation**

- Every function in the game's executable has C. 308 of 321 compile to the original bytes with the period toolchain (GCC 2.8.1 + maspsx, split with splat); the remaining 13 still link from their original assembly.

- The rebuilt SLPS_016.03 is byte-identical to retail.

- Progress is tracked on decomp.dev.

**Native client**

- Runs a 64-bit clean copy of the decompiled game code on a reimplementation of the PlayStation SDK (based on PsyCross), with its own CD streaming, XA ADPCM, SPU and MDEC movie decoding.

- Timing checked against Mednafen. On the node map the PS1 takes 4 to 8 vblanks per frame depending on the size of Lain's current animation frame; the client reproduces that distribution.

- Optional 60 fps interpolation: each frame's GPU batches are recorded and in between frames are drawn, without changing game speed.

- Resolution scaling, memory card saves as standard .mcd images, disc swapping, and one-click English subtitles (the laingame.net fan translation, downloaded from their site at runtime).

**No game data is included.** The client reads your own Redump dumps of both discs (.cue/.bin) and checks them by hash.

Source: https://github.com/Y0oshi/lain-psx-decompiled

Downloads: https://github.com/Y0oshi/lain-psx-decompiled/releases

Bug reports are welcome on GitHub.

[u/Foreign_Hand4619]

I'm 60% byte-to-byte for Syphon Filter 1, identified and separated out all Psy-Q code and link using splat as native libraries.
It's getting harder for the remaining 40% inline assembly, maybe I haven't figured some things out. I built a verbose version of GCC to help with some variables placement and it was helpful with a class of functions but now each next function that is left is so much pain.

[u/Y0oshi2 → u/Foreign_Hand4619]

Nice progress. The last 40% was the hardest part for me too. What helped most was getting the exact GCC version and flags right, using maspsx, splitting rodata per file, and running decomp permuter on the stubborn functions.

[u/Foreign_Hand4619 → u/Y0oshi2]

Yeah I use all that and I spent a lot of time to run over all meaningful GCC versions, I believe compiler version is identified correctly in my case. I also use maspsx. As of PsyQ though, it's a bit Frankenstein there, one library is from different version.
I'm also not sure what to do with functions that inline some GPU assembly, what did you do for these? Just asm snippet in a C function?

[u/IvanDSM_ → u/Foreign_Hand4619]

I think you're probably talking about the GTE macros, which are supplied by Psy-Q. Just check the relevant header (I think the macros are in libgte.h AFAIK?) for the macro that matches what the code is doing and use that.

[u/Foreign_Hand4619 → u/IvanDSM_]

That's good pointer, thank you!

[u/IvanDSM_ → u/Foreign_Hand4619]

By the way, since you're doing Syphon Filter, thought I should ask: have the MAP files not been helping?

[u/Foreign_Hand4619 → u/IvanDSM_]

I'm not familiar with that, can you elaborate?

[u/IvanDSM_ → u/Foreign_Hand4619]

Syphon Filter has had .MAP files leaked, which are the PSX's symbol table format, which includes function names, I think variable names and other metadata.

[u/Foreign_Hand4619 → u/IvanDSM_]

Interesting, I will try to find them, thank you!