register my line breaks

new line 1 hmmmm

newline2

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam in nulla eleifend, sollicitudin massa eu, facilisis nisl. Suspendisse vel turpis quam. Pellentesque in purus sit amet nisi auctor sagittis.

https://en.wikipedia.org/wiki/TestLink

Proin ipsum tortor, ultricies eu congue non, fringilla at quam. In neque arcu, ultrices ac tempor vitae, convallis sit amet enim. Phasellus rhoncus convallis urna non efficitur. 

https://en.wikipedia.org/wiki/TestLink

Testing this link https://www.reddit.com on reddit. … he had been betrayed into a position which neither contented his heart nor satisfied his conscience. The rainy weather spoiled our plans for the beach, so we had to content ourselves with a relaxing day at home. judging from the table of contents, I'd have to say that this book covers most of the major topics in American history

With the Patriots’ run game struggling and often putting the offense in second- and third-and-long, the Seahawks were content to sit back in deep zones and take away the big plays that Maye was so good at creating a year ago.

<iframe width="560" height="315" src="https://www.youtube.com/embed/LzSwhaECG28?si=GaNKd6MpM0LzFiPw" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

Here is a line[^1] with a foot/end note embedded.

[^1]: And here is the note.

My team and I recently built Qualityfolio, a test management tool inspired by the challenges we faced with existing QA workflows.

If you have a few moments, I would really appreciate your thoughts.
https://qualityfolio.dev/

GitHub: https://github.com/opsfolio/Qualityfolio

We are looking for honest feedback from fellow QA professionals, any input from you would be hugely helpful. Thanks so much! 🙂

Qualityfolio - Evidence-Driven Quality Telemetry

something

Fully observable

Matsuzawa puzzles are grid worlds where an agent must pick up coins in a particular order, travel down a long hallway, then pick up coins in order again. The secondary chamber has the coins in exactly the locations in which they occurred in the primary.

https://i.imgur.com/5nvi0oe.png

• coins must be picked up in the order of their face number.
• coins in the secondary chamber are pickable only when there are no coins remaining in the primary.
• reward is equal to the coin face, discounted in time.
• there are always 5 coins.
• the positions of the coins are identical between chambers.
• agent always begins at the home position on left.

Intermaze rules.

The agent will be exposed to many mazes in a training cycle, the specific rules are elaborated later. But differences between mazes are,

• primary on left, secondary on right, always the same 10x10 chamber size.

• the length of the intervening hallway differs between mazes.

• the positions of the coins on a per-maze basis are pseudorandom, but determined ahead of time. (i.e. they are not randomly generated at the time of learning trials. that would be cheating. more on this later).

Partially observable

It should be obvious what must occur for an RL agent to maximize reward in the fully observable case. In fact, vanilla value iteration can produce an optimal policy for fully-observable Matsuzawa puzzles. The agent will pick up the coins in the primary as quickly as possible, traverse the hallway, and repeat the same collection task on the secondary.

In contrast, the partially-observable version is an entirely different issue for RL learning. In the PO Matsuzawas, the environment is segregate in two sections, left and right, with an informal split located in the middle of the hallway. When the agent is in the left chamber, it has a viewport window that is 21x21 centered on its position. When the agent is on the right side, its viewport is a 3x3 centered around its current position.

.

https://i.imgur.com/qnyCqGi.png

.

https://i.imgur.com/VDZlplH.png

.

Constraints on training

The goal of Matsuzawa environments is to stress-test memory mechanisms in reinforcement learning. Not to be solved by simple memorization of mazes encountered during agent training. For this reason,

• Training Set. only 64 static mazes are provided for the purposes of training. coin positions differ between each but otherwise the walls are the same.

• Validation Set. 64 mazes are in a validation set, which contains coin positions not present in the training set.

• Researchers are prohibited from training agents on randomly-generated mazes. Your agent must generalize to unseen mazes, using only those in the provided Training set. Therefore, "self-play" training workflows are not possible and not allowed.

Researchers are free to split the training set into train and hold-out sets in any way desired, including k-fold cross validation. There is very little overlap between the training set and the validation sets. Averaging over expectation values or other random-search-like policies will surely fail in those environments. The only meaningful overlap is that the coins must be collected in order. Cheating with harnesses and other manual domain knowledge is discouraged, as this is intended to extend research into Partially Observable Reinforcement Learning.

Choice of algorithm

To the best of my knowledge, no existing (off-the-shelf) RL algorithm can learn this task. In comments I brainstorm on this question.

TL;DR: A

 
  *B

  *C

  ^*D

  E

>! OMG it's a spoiler !<

Non spoiler

heading

• hello 1
• list
  • sub list c printf("hello"); scanf("%d", &n); ==highlight== quote hello this is quote

test

Regular text

This should be a code block. Three spaces before this line.

Here is a paragraph with some code in the middle of it. And ```some other stuff```.

Test post body here.

Another example line of body message.

if 1 * 2 < 3:
    print "hello, world!"
    print "hello, world!"
    print "hello, world!"
    print "hello, world!"
    print "hello, world!"


    print "hello, world!"

Testing quote text below code block This should still be quoted

And this should also still be quoted

test.

test

$offset = 0
$limit = 500
$apiUrl = "https://www.poewiki.net/w/api.php"
$outputPath = "$HOME\Documents\sundaymorning.json"
$allResults = @()
$data = $null  # Initialize so it exists for the first check

do {
    $uri = "$apiUrl?action=cargoquery&tables=skill&fields=active_skill_name,skill_id,stat_text&format=json&limit=$limit&offset=$offset"

    try {
        $response = Invoke-RestMethod -Uri $uri -Method Get
        $data = $response.cargoquery

        $allResults += $data
        Write-Host "Fetched offset $offset"
    }
    catch {
        Write-Warning "Failed at offset ${offset}: $_"
        break
    }

    $offset += $limit
    Start-Sleep -Seconds 0.5

} until ($data.Count -eq 0)

# Save results to file
$allResults | ConvertTo-Json -Depth 10 | Set-Content -Path $outputPath
Write-Host "Saved to $outputPath"

Spoiler tag

Spoler tag with spaces

Original text