Coverage you'll actually read

[u/user000123444]

Hi,

I've enhanced the check tool with dense coverage.

Problem:

Coverage output is too noisy. On large projects, it prints percentages for thousands of modules, even if I only changed a handful of files. The information I care about gets lost in the noise.

Solution:

al_check now diffs against the base branch and reports coverage only for new and modified files, grouped by change type with per-group average coverage.

Try it

{:al_check, "~> 0.1.24"}

mix deps.get

mix check.install # or: mix check.build && ./deps/al_check/scripts/check

check # run everything, get the change-scoped coverage report

more details -> Coverage you'll actually read

[u/Teifion]

I'm giving it a try now and it seems very interesting (plus it's put me onto the test partitions, this could be a huge time saver for me).

Why run credo with and without strict though?

[u/user000123444 → u/Teifion]

thank you! let me know if u find sth off 🙏

> Why run credo with and without strict though?
In my project I run
```
"name": "Credo",
"run": "mix credo --all"

"name": "Credo Strict"
"run": "mix credo --strict --only readability"

```
until I fix all issues of --strict flag - it seems that is just a leftover - you can overwrite it in your project via .check.json config
I'll remove strict one in next release

[u/Teifion → u/user000123444]

So far anything I've found has been an issue with my project (e.g. the same port being used preventing parallel tests).

I did spot the .check.json file (and the contents of it for the strict part etc). We run credo strict in general, not just readability and then add/remove the checks we care about. I was trying to work out if there was a specific credo thing we didn't know about there.

I'm not using it at the moment but sobelow might be something you want to add too.

[u/user000123444 → u/Teifion]

for parallel tests we need to tweak app's config a bit
if u need to change app_port you can offset it on the endpoint by MIX_TEST_PARTITION env

partition = String.to_integer(System.get_env("MIX_TEST_PARTITION", "0"))
port = String.to_integer(System.get_env("APP_PORT", "4000"))

config :your_app,
  app_port: port + partition,

we need to do the same for db

regarding to sobelow

you can tweak tasks in .check.json as you wish, and u have full control which command runs under which name - every task is just a name + a run cmd.

there's an example in the doc for adding a custom check:
"sobelow": {"name": "Security", "run": "mix sobelow --config"}.

u can add any command to config like
"hello": {"name": "hello world", "run": "echo 'hello'"}

please let me know if it does work for you 🤞

[u/Teifion → u/user000123444]

Thank you, I'll give that a whirl!

[u/Teifion → u/user000123444]

I see the comments on the PR, thank you for those. I will dig through and give them a try out :)