Red bean is a staple of many Chinese desserts and it tastes sweet on its own. It makes for a good dairy-free popsicle and is quite common in China.
Vanilla and chocolate are made using beans as well; other than the fact that you can make red bean into paste and eat it as-is or frozen without milk or added sugar, it's not that crazy a concept.