https://store.steampowered.com/app/520720/Dear_Esther_Landmark_Edition/
https://store.steampowered.com/app/297350/The_Old_City_Leviathan/

Recently played Draugen and it was pretty good.

https://store.steampowered.com/app/731040/The_Invincible/

I've played 3 of the 4 above that you mention and liked them. I'd recommend these as scratching similar itch, maybe not pure walking sim though:

Event[0], Tacoma, Turing Test, Abzu, Stanley Parable, Her Story, Timeframe, Verde Station

NaissanceE, Shelter, Virginia

https://store.steampowered.com/app/251110/INFRA

Death Stranding? :kappa:

Edit: more seriously (and affordably), Dear Esther was recommended above, the only one I've played. I've only heard good things about Stanley Parable, so a +1 from me too; and I'll add Last Day of June to the recommendations list.
New edit: I forgot I played Firewatch for an hour or two at a friend's place. Very nice, too. Also saw Ethan Carter in a comment below; didn't play it yet, was given on Epic. Heard lots of good things about it.

These are all the same style with heavy story, point&click style gameplay, choice & consequences, and light puzzle solving-

Telltale's The Walking Dead Also has sequels and a spinoff game
Life is Strange Also has a newer remastered version and sequels/spinoffs
Telltale's The Wolf Among Us

Looking for similiar games to What Remains of Edith Finch, Suicide of Rachel Foster, Firewatch, Gone Home.

I own only Suicide of Rachel Foster and I never played it yet, so I'm not sure that's what you're looking for, but maybe something like this:
https://store.steampowered.com/app/258520/The_Vanishing_of_Ethan_Carter/

https://store.steampowered.com/app/417880/Everybodys_Gone_to_the_Rapture/

I know FranckCastle suggested it above already, But I would genuinely recommend Death Stranding. It fills those tags perfectly.

I may be a little bias as I have 100% the game, and have about 120 hours in total across the original and directors cut. But I genuinely very much enjoyed the game. It does well to evoke emotion, and to build this 'real-world adjacent' but still foreign world.

The atmosphere and aesthetic is quite well done, and the story is quite in-depth, and is also the primary driving force for progression in the game. While the gameplay might not be for everyone, it is definitely a walking sim.

Not direct recommendations, but here's a tip; I find the following site gives better "similar games" than steam itself, so here are the results for the games you mentioned:

• What Remains of Edith Finch
• Firewatch
• The Suicide of Rachel Foster
• Gone Home

You can also tune the search by playing around with the search params, like excluding specific tags (say horror), etc.

https://store.steampowered.com/app/638230/Journey/

Here are some you didn't mention that I have played and enjoyed. Some of these may be a bit more interactive than what you are looking for. A Story About My Uncle is missing the walking simulator tag, but all the other games have walking simulator, atmospheric and story rich tags.

Last Day of June - Has puzzles.
Life is Strange
Tell Me Why
SOMA
What Never Was - Short, free, introduction to what will hopefully turn into a full game at some point.
A Story About My Uncle - Has some action with platforming and swinging with a grappling hook.
Kona - Has survival aspects
The Vanishing of Ethan Carter

Thoses ones were pretty good:
https://store.steampowered.com/app/632070/The_Fidelio_Incident/
https://store.steampowered.com/app/258520/The_Vanishing_of_Ethan_Carter/
https://store.steampowered.com/app/475190/Scanner_Sombre/
https://store.steampowered.com/app/433100/The_Town_of_Light/
https://store.steampowered.com/app/258950/Montagues_Mount/
https://store.steampowered.com/app/1042490/Call_of_the_Sea/
https://store.steampowered.com/app/747360/Gray_Dawn/
https://store.steampowered.com/app/968870/Close_to_the_Sun/
https://store.steampowered.com/app/343710/Kholat/
also
https://store.steampowered.com/app/298260/Only_If/
https://store.steampowered.com/app/866440/What_Never_Was/
https://store.steampowered.com/app/629840/Caligo/
https://store.steampowered.com/app/546700/The_Butterfly_Sign/
https://store.steampowered.com/app/1049400/Answer_Knot/

and as well
https://store.steampowered.com/app/409160/Dr_Langeskov_The_Tiger_and_The_Terribly_Cursed_Emerald_A_Whirlwind_Heist/
https://store.steampowered.com/app/356050/Beyond_Eyes/
https://store.steampowered.com/app/558420/Stories_Untold/

Town of Light and Ethan Carter and Dear Esther are going to be closest to the games you mentioned.

https://store.steampowered.com/app/2377300 rest house iii - chlorophilia
https://store.steampowered.com/app/625370/ a second before us
https://store.steampowered.com/app/1949840/ disharmonia
https://store.steampowered.com/app/223510 miasmata

Everybody's Gone to the Rapture is amazing.

If you ever get it, be sure to read the top review talking about save points.

https://store.steampowered.com/app/428660/Deliver_Us_The_Moon/
https://store.steampowered.com/app/573130/Aporia_Beyond_The_Valley/
loved these too

I hope to introduce you to a few of them

in no special order
SOMA
Life is strange series
The Last Show of Mr. Chardish
Ghost on the Shore
11-11 Memories Retold
The Turing Test
Kona
The Vanishing of Ethan Carter
The Invincible
The Wreck
Last Day of June
Deliver Us The Moon
South of the Circle

Can I suggest joining this steam group? Walking Simulator Fan Club
They have some great recommendations and new are added to this day.