This is the same in the UK, it depends on context based on the industry. IT contractor is synonymous with freelancer in the UK traditionally.

Most of the UK population, if asked "what's a contractor" would assume construction.

When I lived in the UK for a bit, iirc people would use the term "builder" where I would say "contractor".

At least in American English vernacular, saying "he's a contractor" either means he builds houses, or he's an independent contractor (doing some "consulting-ish" work). The lack of context for that phrase is indeed confusing!