Multipliers are useful (even without feedback) if one wants a variable gain (say, to turn up the volume): tweaking one voltage will control another.
Gyrators are useful as circuit elements that behave like inductors. Classic inductors (little coils) can be bulky and expensive, and often won't fit into small packages. Gyrators can also compactly simulate other reactive circuit elements.