Really, this isn't a "bomb/sword" build, this is just more of a regular build that's designed to accommodate bombs. If that's your intention, then it'll do fine; bomb CTR/damage, sword ASi/Damage. You're lacking a bit in terms of gun bonuses, but I imagine that's mainly just for turrets. You might want to consider gettin' more bombs though, becasue if that's the case, then one control bomb and one pure dps bomb won't go smoothly with your build; you'd probably want a vortex and a haze; probably AoA and EV, in which case you can ditch the Mad Bomber hat in favour of a Volc.Demo hat and get yourself even more fire res and some better base defence, since the damage on bombs won't be your main concern.

If you want a heavy bomb build with great access to swords, this is your best bet:
Full Mad Bomber, +10 Bombs, an E-Boom Trinky and an E-Slash Trinky with Barb.Shield.
Max/max bombs and VH damage swords right there.
ASi may be good for your swords, but it's +2 in sword bonuses at the cost of +4 in bomb bonuses.
Switch out the Mad Bomber with Volc.Demo to cancel the fire res and you're set; then you can just switch out your E-Slash with another E-Boom if you want your max bomb damage back.
Now, the issue isn't your choice of gun, since Storm Driver's pretty nifty and all, the issue is that for a "bomb/sword" build, you only have two bombs and a sword, and then a gun that really has little place. One of your bombs is control and won't benefit from damage (so I guess your current set is..sufficient for that) but the other one will require it, especially since it's a tricky bomb to use. You'd ideally want more bombs than that.

It really depends on what your actual intentions are with the build. Do you want it to be a hybrid mash-up build? Or are you going for a heavy focus on bombs and/or swords?

For FSC, pack a Gray Owl; you won't get your money's worth with Skelly in there at all.
Mad Bomber will only be worth it if you plan on using DPS bombs a lot, and by the looks of your build you won't be bomb-dpsing nearly enough to justify the penalties that MB will give you. You're stuck in the unhappy middle ground right now and need to pick between shifting towards swords/control bombs with the VDH, or dps bombs and altering your loadout to suit that.

Skelly shield is mostly useful in Fiend levels and SLs; not really anywhere else. Useful enough that it's not worth selling, not useful enough to be worth worrying about for some time yet.

The "second paragraph" was me suggestion the build I use as an alternative to your "sword/bomb" predicament; an ideal pure bomber build that allows for pretty powerful swordplay.

Full Mad Bomber set
E-Boom Module
E-Slash Module
Barb.Shield
Fast-Med Sword
Haze Bomb (Shiver, VT)
Damage Bomb (DBB, Nitro, RSS)
Haze/Vortex Bomb (GV, EV, AoA, VV)

This loadout will give all your bombs max CTR, max damage (assuming the bombs are +10) and will give your sword damage:VH. Run a fast sword (let's say a Brandish line, ideally Glacius or so for the nifty status) and you've got a fast, hard hitting sword with a decent bonus effect.
And that's your sidearm utility sword. VH damage, fast, status.
The rest of the juicy stats come into your bombs; max damage, max CTR. For the bombs you generally want a mixed selection to play about, but if you can only afford 3 bombs to start with, then Shiver/VT, RSS, Vortex would be the way to go. A lot of control and damage in that bundle, especially with the set.

Only thing to remember is that it is a pure bomber build, and with that comes huge negative resistances and low defence, so it relies on using your control bombs carefully and being good at not gettin' hit.

Then you probably wanna shift the other direction;
Volc.Demo Helm
Swordy Suit
BTS/Swifty
Sword, Gun and...probably AoA/VT/Shiver and EV/GV.
Bung some E-Bomb Focus mods on top of that and you'll have solid swordsmanship and some fast acting control bombs, topped with some decent defence and a lot of fire res.

Shivermist = causes freeze. Only damages them if they "thaw", and refreezing them or breaking the ice will mitigate the damage, making this a terrible bomb for damage, it's pure control bomb (as discussed here) and it's damn good at its job. Not much good for anythin' other than control though.

Ash = No control whatsoever, just leaves a nice hearty DoT on everything and sticks around long enough allowing you to kite things through the haze to get as much as possible on fire; let it spread from there!

VT = Same as Ash, but has a degree of control since shock causes spasms. Note that on its own, shock will cause less overall damage than fire, BUT if the enemies are clumped together and allow their shock spasms (which are, ofc, aoe) to hit each other, it racks up as higher total damage. Both of these bombs go well together for huge DoT and a degree of control.

Stagger = The suicide bomb. Stun is bugged on Monsters and will likely just get you and your party killed.

VV = Poison, a pretty niche Haze. Good for helping keep healers out of commission and increasing your damage, but generally not as useful as the DoT hazes. Echoez gives a pretty good summary of it here.

EV = Just like Graviton, except elemental instead of shadow and causes shock. The main reason to use Graviton over EV is for Slime/Gremlin maps, where the dps difference is worth sacrificing the shock usually; for most other occasions EV works nicely for the shock, but it's not THAT important that you absolutely need it; if you want to stick with Graviton you'll be fine.

Electron Vortex is the exact same as Graviton Vortex except that it's elemental and causes shock. Keep in mind that EV is a Krogmo recipe, so if you want to get it you'll need to save up 300 Krogmo Coins. GV is a regular recipe and otherwise more easily accessible.
But like I said, the EV isn't so much better or anythin' that there's no point usin' GV, you can absolutely use GV fine and survive without any problems at all.

http://wiki.spiralknights.com/Electron_Vortex

The recipes are at the Krogmo vendor. The item description doesn't say anywhere that it causes shock, but it does.