I have seen a lot of great DIY carpenter bee traps that fill up with bees. I have friends that say the traps keep them out of the house.
https://www.pinterest.com/explore/carpenter-bee-trap/
We recently purchased a new oven/range as the last one had a pretty bad gas leak. Glad we did as it was a potential danger. We got it on sale also, which was an added benefit!