However you choose to use the Compass app, you'll need to calibrate it the first time you open it, something you'll be prompted to do. After that, the compass should calibrate automatically ...

Once you're in the calibration settings (or mode), you should be able to increase or decrease the temperature easily — although how you do it, again, depends on your specific oven model.