I think many of us have done this at one time or another - there is just nothing to say as you just drift apart - and saying something might just prolong a conversation that you don't even want to have - so yes, I think it is best to forgive yourself and move on -