One audio clip affecting the adjacent one?

[Cassel]

I had noticed this when I tried using a loud audio sound effect so I removed it and changed it to something else but I am concerned about this. Here is the situation:

Segment 1: talking head video
Segment 2: black block with animation and no sound
Segment 3: black block with animation and a short sound effect (breaking glass)
Segment 4: black block with the end of animation and voice from the video
Segment 5: back to the talking head video as a continuation of segment 1

The problem I notice is that the sound, in segment 4 is very low as if the video is "recovering" from the sound effect in the previous segment. It is like it adds a fade-in where I don't need one at all.

Is that a normal "reaction" of the audio after a sound effect?

[rwernyei]

Settings>Preferences>Edit
Under Audio uncheck the box Apply audio cross-fade automatically
Click OK

[Cassel]

Settings>Preferences>Edit
Under Audio uncheck the box Apply audio cross-fade automatically
Click OK

That didn't change anything. Is it supposed to take effect on the current project or only on future ones?