I think that is your best bet but as a long shot we might be able to find some files that you can remove
How to create a bootable Puppy USB Drive
- Download and save a copy of the latest Puppy ISO file
- Download and save a copy of Unetbootin for Windows.
- Insert an empty formatted USB drive into a USB port on the computer that's being used to create the bootable USB.
- Launch Unetbootin ....
- Ensure that Disk Image is selected.
- Using the browse button ... browse to and select the Puppy ISO file.
- Ensure that Type: is set to USB Drive and that the Drive: letter corresponds to the USB drive.
- Click OK
Next
You need to change the boot order of the computer to boot from a USB drive ....
- Read HERE for instructions how to do this.
Now boot into Puppylinux
when you get to the desktop Click on each of the drive items found in the bottom left corner to mount them (when mounted they will have a red cross next to them)