Make sure the shrimp are cleaned and all shells and tails are removed. Roughly chop the onions, bell peppers, and cilantro. Peel the garlic, and seed the Habanero pepper. Zest and juice the lime.
Set out a food processor. Add the onions, bell peppers, cilantro, garlic, and Habanero. Add the lime zest, but reserve the juice for the slaw. Pulse a couple of times to chop the veggies into small pieces. Add in the shrimp. Pulse a few more times to cut the shrimp into small pieces. You don't need to puree the mixture; pulse just a little so you can still see pieces of shrimp.
In a large mixing bowl, mix the shrimp mixture, panko breadcrumbs, egg, salt, allspice, and ginger. Mix until smooth.
Set a large skillet on the stove top. Add the oil (or butter) then set on medium heat. Form the shrimp mixture into 4 equal patties, just slightly larger than the hamburger buns.
Gently move the patties to the hot skillet, and cook for 5-6 minutes per side. They should be golden brown.
