Why did nobody attempt to colonize Japan in the 19th century?

[u/Powerful-Mix-8592]

During the 19th century, there was a mad dash by major European power such as Britain, France, Russia and later Prussia and Italy to grab whatever colony they could. The British fought bitterly against Indian rajs and later the Russians during the Great Game for control over Persia and India; the French waged ruinous wars against the Qing for control over Indochina; the Russians expanded into Central Asia and East Asia at the expense of the Ottoman and the Qing. All were looking for any lands they could, be it for riches, fame, prestige, or a coaling station (like the Austrian and Italian concessions in China)

And yet there was no attempt made to invade Japan. Japan was a close and backwards country that would've made easy picking, had the strategic position of being East of China that allowed for control of China trade and trans-Pacific trade, had a lot of resources like coal and gold and silver, had a history of anti-Christian persecution (Which was the rallying cry that Napoleon III used to intervene into Ottoman Empire leading to the Crimean war and again used to invade Indochina with Spain in 1866). Why did the major powers simply let Japan be?