Would canceling interviews look bad on my application next year when I reapply?

Thankfully I got couple of interviews in places I like, but unfortunately my work permit would take on extra year and 2 years for my green card. Would it be silly if I choose not to go through J1 process again_I already went through with my husband _ and wait next year for the work permit and hence the green card? And how would it look on my app to the programs who already sent me an IV and I strongly want to match there next year if I cancel now! Thank you