Why do my roller wheels wear down so fast?

I skate on asphalt with Labeda Asphalt (orange) and they wear down so fast after a single skate that both sides are down about half the size. I do skate on my edges quite a bit but I didn't expect them to wear down that quickly based on other people's experiences I read online. My wheel setup is two big ones in the middle and smaller first and last.