How to I play my flush draw in this spot

So I'm playing a $1/$2 cash game. Bought in for $80 and I quickly double up to $160ish so feeling good. In this hand at a 9 person table, I am in the BB when the button straddles for $4, SB folds and I call for $4 holding A♠:5♠:. 3 other players call the $4 , button checks his option and we see a flop. The flop is A♦:4♠:6♠: so a pretty great flop for me. I am first and check ( okay in hindsight perhaps a bet would have been better but I figured let's see what my opponents do ) It goes check, check, villain bets$22 (he has me covered) , button folds so it's over to me. I call the $22 while other two fold. The turn is a brick 8, I check again and he bets $60. I think about it but lay down my top pair and draw to the nuts. I feel very bad then he turns over 2♠:3♠: and I feel even worse. What did I do wrong? A great session and I played solid elsewhere but I played this hand wrong.