Successful individuals are never afraid of layoffs, because they know that any employee can be laid off at any time, it's outside of their realm of control. Successful individuals don't worry about this because they have confidence in their own value, they know that they can simply find gainful employment elsewhere.
In my experience, those who worry about layoffs tend to have low confidence in themselves and are typically externalizers who blame others for their own short comings. If you spent the last 20 years scheduling meetings and assigning CDETs to remote staff members, what sort of value do you suppose you would bring to a new company? If the answer is "none" then it's up to you to step and make something more of yourself.
You will thank me one day.