My amp is still pulling power from my battier and i have a toggle switch runing from the radio to the amp?

its killing my battier some how i think the amp is still pulling power from the battier how can i fix this?