I just couldn't flash the bootloader with USBtinyISP. According to the datasheet the fuses should be set to internal oscillator, so it should have worked without the quartz, but it didn't! I thought I had fried the chip, but it just needed an external clock source