Wigan Athletic narrowly missed out in a wet and windy game at the John Smith's Stadium as Adam Clayton's 85th minute drive from distance settled the tie with the Terriers holding out for a 1-0 victory.
A dominant start to the second half looked promising for Latics, with debutant Martyn Waghorn coming close twice and Marc-Antoine Fortune having an effort deflected onto the roof of the net, but it was always looking like a game needing of a piece of magic, which Clayton delivered.
Uwe Rosler made four changes from last weekend's victory against Charlton Athletic, with Waghorn making his debut, last week's goal scorers Fortune and Jordi Gomez also coming in alongside Stephen Crainey.
The conditions were unpredictable right throughout the 90 minutes, with the wind carrying the ball in the first half and holding it up in the second, but Latics made a bright start to the game with the clear aim of pushing forwards.
After holding out some pressure from Huddersfield, Latics sprung into life down the left wing with Jeane Beausejour as he created the first real chance of the match.
The Chilean pounced on a perfect pass from Crainey and had James McArthur and Waghorn waiting in the area, with the latter having a first time effort turned behind by Alex Smithies.
Latics were forced to hold out spells of pressure from the hosts, as they looked to use Adam Hammill often down the right side, but timely clearances from the likes of McArthur and Boyce kept the Terriers out.
On 35 minutes Beausejour created again, playing a low cross into the area and almost forcing an own goal from Joel Lynch, who sliced a clearance inches past the right post.
Just before the break Fortune lashed an effort over from the right side, but Latics used the late flurry to spur them on at the start of the second half when their game really grew.
Waghorn hit the side netting a minute in, James Perch then headed over at close range from a corner, Ben Watson had a shot blocked and the onslaught ended with Waghorn connected first time with a volley at the back post, hitting the side netting once more.
Fortune got in on the act soon after when his run into the area resulted in a deflected shot rippling the roof of the net, but the best chance fell to Waghorn and McArthur who couldn't finish a perfect cross from Gomez.
The Spaniard picked them both out at the back post, but as the pair arrived, McArthur missed his connection and Waghorn turned the ball wide from close range.
After riding out the heavy pressure, Huddersfield began to create some of their own and long range efforts began to warn Latics of what was to come.
Distance specialist Oliver Norwood thought he had scored on 80 minutes, but for the goalkeeping heroics of Ali Al Habsi, who tipped his 40 yard free kick onto the cross bar and gathered the ball as it bounced back down almost onto the line.
The warning shot had been fired, but Latics couldn't keep the next effort out as a half clearance fell for Clayton to take advantage.
Clayton shifted the ball out of his feet and struck right footed, dipping the ball into the bottom left corner of Al Habsi's goal.
Nicky Maynard's introduction late on wasn't enough as Huddersfield remained calm to see out the game and collect the three points.