Can a soap recipe interfere with how long a fragrance oil will last in the soap?

When I use this soap recipe, coconut, palm, olive, castor (10%) & shea butter (4.8%), sometimes my fragrance oil will either disappears ( sometimes within a week) or they won’t last long  (2 months). I use 6% FO in my batches. I do hot process. I have used the FO in other recipes and they seem to stick better.

Thank you