 While Rubes cause of death is never outwardly stated, several of  the second season episodes hint that on the night he was killed,  Rube tried to rob a bank (the wanted poster Rube finds when  searching for information about Rosie, and the gun hes constantly  carrying around in his flashbacks).