Ray...
I think it would be a nice way to honour your maternal side of the family. I too felt little connections with my dad growing up, but, we do now get along and I would much rather have his name than my ex's last name . IMO it's a terrific tribute to those who have supported you throughout your life.
Many Hugs To You!!
Dottie