Rogue waves, breather-to-soliton transitions and modulational instability for the nonlinear Schrödinger equation with octic operator in an optical fiber

Abstract The nonlinear Schrodinger equation with octic operator in an optical fiber is investigated in this paper. Via the Darboux transformation with complex spectral parameter, we obtain the breathers and rogue waves for the equation. When the propagation directions of the two colliding breathers coincide, breather-to-soliton transitions could be observed, and breathers can be transited to two kinds of solitons, i.e., the M-shape and W-shape solitons. It is found that the coefficient of the eighth-order term η is necessary in the transition condition. Interactions between the solitons and breathers are shown to be elastic. By virtue of the separating function, rogue waves are seen to be separated into the so-called “triangular cascades” or “pentagram” patterns. Number of the separated first-order rogue waves seems to be related to the order of the rogue waves. Modulational instability for the generalized plane wave solutions is conducted, and we find that η does not affect the stability of the solutions.