I agree you should be worried, for a few reasons...

1. The jinx...England haven't beaten Sweden in a World/Euro match in their 7 last attempts
2. England's big tournament history...not a matter of if you stand on a banana skin...more when.
3. Gerrard has added a double jinx telling the media:

"I would think the same level of performance against France will be good enough to beat Sweden."
...I would say so with all due respect to Sweden who are a good, strong team, but they are not France."