Only being able to correct the quality downwards is tedious
ever tried SHIFT-Clicking on a control? It will go a step down instead of a step up then.
Also, you could move the quality slider to "best compression" which should bring all samples to a very low quality so you can easily go up step by step