My buddy Jake had siding right against his trim just like that. Took five years before he found soft spots and mold in the wall behind it. The repair bill was way bigger than just doing the gap right the first time.