sometimes but not regularly = happening or existing only some of the time. If something happens off and on during a period of time, it happens sometimes.
I've had a toothache off and on for a couple of months.
She's been taking drugs off and on since she was 16.
He worked off and on as a bicycle messenger, but he never found permanent work.