How do I remove or unsubscribe Solve from my Google apps domain?

From within your Google Apps administrator account open Gear (top right) > Manage this Domain > Marketplace Apps > Click on the Solve app > Delete Solve.