A disappointing day all around saw the Mariners concede three goals before the half hour mark, and despite a late flurry of goals, Town went down to only their second defeat in October at the Shay.
Speaking after the game: Hurst said: ''We were certainly punished and they were very dangerous on the break. I think we had more of the ball but then gave it away in some bad areas.
''The first two goals certainly were through an inability to defend a cross and then a set a piece, a ball into the box so we were punished and they were lethal in their attacks.
''I still felt we were in the game, even at half time to be honest, I felt we'd had enough of the ball in and around in the box but in the end, what happens in both boxes determines a game of football. Halifax were certainly very clinical and we were perhaps a bit toothless. That said, there were a few things happening, it was getting to the point that I thought we were never gonna score and as it turned out, we happened to get two goals but it looked like of those afternoons and things weren't quite dropping in the box.
''We had a couple, Clay's not got contract on a header and Ryan Jennings hasn't got contact early second half which could've been a way back into the game.
Padraig Amond scored a late goal to make the game 3-1 but the three goal defecit was restored a minute later through a Jake Hibbs free-kick, and the Town boss believed that this summed up the fortunes of both sides on the day.
He said: ''Again, you'll have to give the lad credit, a great free kick in off the crossbar and he won't hit too many better. That summed up their afternoon and ours to be honest. A good day for them and a bad day for us.
''Naturally, confidence is gonna take a hit, we've had a good long chat in there, which will of course remain private, where a few home truths were said.
''Overall, what we have to look at is the position we're in, the top two have won again and realistically that top spot is too far away but after that, we're still in the best position for a play-off position. What we have to do is try everything we can to get back to our best and get back to winning ways.''
With Town having picked up two disappointing results in their previous two games, Hurst says that the next fixture is a chance to respond and that the players must do that.
He said: ''You look at other results and there's a lot of teams going through a dodgy spell, I don't think ours has been long enough to be that but no doubt, the last two results are disappointing.
''As I said, there's been a few things said and its a quick turnaround which I prefer because we've got an opportunity to put that right at home against Woking on Tuesday. They're a team that we've got twice now and have certainly got players that can hurt you so we've got to make sure we're nice and solid, which was something that was out of character today.''
''We've got one of the best records in the league defensively so we've gotta make sure that was a one off because that's where the basis for everything comes from. You look at Cheltenham's run and realistically, that has been built on being solid at the back, and for large parts, we've been that.''