Yup, that's the idea. It's a bit of an effort, but if you're game aim for temps between 40 and 60C, however you want to go about it. Less than 40 and you'll still get appreciable warping, and more than 60 and your motors and plastic parts will have a bad time. You might have luck with judicious use of a hairdryer; just be careful to monitor the temp as you go.
It's still a bit of a WIP, but my solution was a 250W AC plate heater, a heatsink, a 50mm 12V centrifugal blower, and an eBay PID controller / SSD / thermocouple set. I set the output temp of the thing to 50C, and sit it in the bottom of the case. Resulting chamber temp with my enclosure and current ambients (12-15C) is just on 40C (monitored by multimeter), and this seems to have a significant effect on warping - I can now manage much larger prints then I ever used to, and when the bed cools down things still pop off nicely.
SD3. Mk2b + glass, heated enclosure, GT2 belts, direct drive y shaft, linear bearings, bowden-feed E3D v5 w/ 0.9° stepper
Smoothieboard via Octoprint on RPi