I'm not sure HL2 benefited much from it's physics.
Puzzles were poor, simple, and felt forced just for the sake of it.
While you have every right to an opinion, most would disagree with you.
Gravity gun was fun, but has been done long before HL2.
What game? Same implimentation (i.e. interaction with physics-based objects)?
Anyhow, The Orange Box is getting some odd hate. Looking at its individual parts:
Half-Life 2. One of the best SP FPS ever. Great story/storytelling, long by today's standards, great artistry, and excellent voice/facial/gesture package. Contains some gameplay variety and is more of a thinking man's shooter, emphasized by the Physgun. Some may not like the "I am an uber hero" design, the frequent save points and linear progression, some of the different game locals (coast, Ravenholm, puzzles), etc but in general most consumers liked the total package. A lot. And while "dated" Valve did add some new spit and shine to the game (but appear to have failed on 60fps on the consoles and left out dynamic shadows?)
Ep.1&2. Ep1 was short and the weakest of the SP elements, but still a quality (short) SP experience. Ep2 has a number of technical improvements and goes with a slightly more open design at the end of the game. Physics are impressive, facial animation is even better, and the wooded areas look nice.
Half-Life 2, Ep1, Ep2, and Lost Coast, as a single package, is one of the highest quality--and long--single player FPS experience available. For a typical gamer the SP elements of the Half-Life 2 series are going to last 25-30 hours. This isn't filler. It is also nicely packaged into distinct segments so instead of getting bored, you can view each chapter as its own game.
I think it is noteworthy that, outside of the HL2 port to the Xbox (which was late in the dieing platforms life and technically just passable) this is the first oppurtunity for most console gamers to touch Half-Life 2. So while an "old" game it is essentially new to the consoles.
But there is more!
Portal. Just go watch the videos of this mini-game. It only last 3-6 hours for good FPS players, but it is excellent. This is an amazingly designed game that fuses the first person perspective with excellent puzzle elements. And it is humorous. If you don't like Portal you really don't like games. Heck, even the 2D flash Portal knockoff is fun. The concept is so simple and appeals to the "old school" thinking-puzzle style games (both electronic and otherwise).
Team Fortress 2. The bad: TF2 has only 6 maps (11 if you count all the Hydro maps individually). But boy are those maps great. Every class can be found useful in every map. TF2 is big on
TEAM. This isn't slayer--far from it. The game design--from classes, to objectives, to map design--funnels gamers toward teamplay. Valve addresses so many issues in FPS MP it isn't even funny. e.g. Medics in most games are boring and/or pointless as you wait behind your front lines healing the few injured who are lucky enough to retreat (which is typically useless with fast spawn timers [you cannot count on smart medics in most games!] that diminish the cost of death as well as squad spawn points). TF2 addresses this as you are an active healer. Just point your healing gun and fire. Teammate healed. Better yet you can follow them right into battle and keep them healthy as a 1-2 combo. Best yet, when you have done enough healing you become the ultimate gamebreaker--Ubercharge. You and your target are now invulnerable for 10 seconds. So the guy on your team who cannot aim a gun? Be a medic and win the game!
Which brings me to another element of the series: stalemates. TF2 offers a lot of ways to avoid stalemates. Is the defence on their last Capture Point and fortified? Build up uber--better yet get 2 or 3 medics charged--and make a brutal assault. Or send in a slew of spies and have them destroy the sentries. The game really tailors toward all sorts of gameplay styles (like any good Class Based FPS should) which have excellent Rock-Paper-Scissors elements that overlap uniquely throughout all the 9 classes. If your aim sucks? Be a medic, or engineer, or heavy. Are you more of a thinking shooter fan? Be a spy (totally unique class), engineer, or demo. Are you a twitchy shooter fan? Be a sniper, scout, or soldier. As the game is objective driven the game really drives you toward working as a team--not just killing. You end up picking your class based on team based needs and how the flow of battle is going. Valve got everything right with the core game. Yeah, more maps and gamemodes (VIP/Escort would be nice) could have been included, but the game itself is deep, very polished, and highly enjoyable.
Valve was also very conscious of the Team/Objective/Class driven gameplay and that, ultimately, the game wasn't about "who is the best" but instead "who helped their team the most". The stats reflect this and are very much focused on personal bests with the important elements of each class. Finally, the game looks awesome. Great art. The amount of effort put into the unique design of the game shines through. This isn't just "good artists making high quality assets" but a very focus driven design created to accent the unique gameplay. TF2 is one of the best MP FPS games ever created.
And now add it all together.
Half-Life 2 + Lost Coast
Episode 1
Episode 2
Portal
Team Fortress 2
I would say The Orange Box is a canidate for GotY, except HL2 already won a lot of those awards in 2004. As a package you get an amazing (and long) Single Player experience in HL2/Ep1&2/Portal and one of the best Multiplayer packages on any platform -- all in one game. The package as a whole as a ton of innovation and quality design.