There's no such thing as truly free trade. There are arrangement by which two parties will enter an agreement not to place unduly onerous import duties on each other whilst both parties think that they are getting the better deal out of the agreement. The moment one or the other thinks they're being taken for a mug it all fall apart and the punative import taxes are levied on (randomly) selected classes of goods.
So a Free Trade Agreement is more like a cease-fire in a trade war than anything to do with freedom.
I can't speak for US-Australia, but that's been my view of such agreements between US-Europe, and I can't see why Oz should be any different.