The paddler who got into trouble when his kayak became swamped in the harbour has been rescued from a channel marker by boat.

The man, believed to be in his 40s, was in a kayak when he got into trouble in the harbour about 400metres from Fergusson Park in Matua around 12.30pm on Wednesday.

A man has been taken to Tauranga Hospital after being rescued from Tauranga Harbour this afternoon.

A surfer at the park went out to assist the man before the two were picked up by a boat and returned to shore at Sulphur Point Marina.

The man, described by police as 'very cold and shaken”, was taken to Tauranga Hospital by St John Ambulance paramedics to be checked out.

Acting Sergeant Andrew Crockett says it is believed the man was in the water from 11.30am, but police are unsure how he got into trouble.

'He may have turned and taken a bit too much water into it.”

Police and Coastguard were called to help after Fergusson Park residents heard distress calls from the man.

Hearing the distress calls, surfer Jeff Dent from Guatemala, who was down at Fergusson Park at the time threw his surfboard in and offered assistance, says Andrew.

It is not known whether the man had a life jacket while he was out kayaking, but he did not have one when he returned on the boat, says Andrew.

'I guess the message is if you are going to go out on the water make sure you have a life jacket.”