Err.. I described the settings as if they were for a person you wanted to grow/shrink, but of course in your case they're the rough settings you'd use on a trigger for the empty object, and will change the world instead. The same method works.
Totally doable. Download this scene here: https://hub.virtamate.com/resources/gtsn%C2%B01.6581/
and extract the ScaleReceiver plugin.
You can then add an empty object to your own scene, and set ScaleReceiver as a plugin on it. Make sure 'Sync World' is ticked in the settings for the...