If you think you have the ability to "fuck off" whenever you please I don't see what you have to worry about. You get $500 more per month which is $6000 more per year. If you're not happy you can just "fuck off" after a year with money in the bank to a job which pays even more.
I estimated that I will still need to work in this job or that new job for about 5 more yrs or so. If I jump to the new job with extra $500 more per mth, it will be extra bonus for me 5 yrs later. But I am worried I might end up quitting from the new job if it is too stressful kind. That was my concern.