Soul Eater - Yeah say what you will but this thing kicks ass even on Forces. Slap on a power mag and this and you can cut through guys easily on Normal, Hard, and even some parts of Very Hard.
Hildebear or Hildeblue cane - An enemy part weapon. Gives an MST boost, as well as a DFP boost. Plus it gives a boost to Foie (Bear) or Barta (Blue)
Double Saber - I only recommend this for the TP Steal (Soul) special attack.
Elysion - Don't feel like using magic all the time? Elysion is a good force melee weapon.
Holy Ray - It's a gun with Rifle Range. The special attack (Arrest) is great and should you ever decide to get the chance to go to towers, it's a great addition if you wanna play things safe.
Bringer's Rifle - Great Rifle with an HP reduction special (Demon) if you wanna do something more than Nuke. Also a great addition in towers and not just for FOnewm. All FO and RA classes actually.
Technical Crozier - It's an okay Force weapon. You can get this for free out of Soul of a Blacksmith on Ultimate (offline quest).
Sigh of a God - Looks cool and boosts Zonde. Also it's special attack is Gizonde!
Magical Piece - Great weapon that boosts GI- techs. You can only make this with a Magic Rock Heart Key.
Summit Moon - Boosts Simple Techs (Foie, Zonde, Barta). You can only make this with a Magic Rock Moola
Twinkle Star - Boost GI techs like the Magical Piece. This one doesn't boost them as much as the Magical Piece but it gives more MST. Plus I think this looks cooler. Made only with a Star Amplifier.
Brightness Circle - Not one of my favorites, but the EDK bonus alone is enough for me to suggest it (for those damn Lillies in ultimate). Tough to find, but you can always make one too if you have a Spirit Garment and Star Amplifier
Luminous Field - Slightly better than the brightness circle but EDK and ELT are worse. Still a good choice.
Guard Wave - I like the cool little effect it has. Not as great as Brightness or Luminous, but you can get it easy if you pipe rappies on ultimate forest on Greenill.
Smoking Plate - It's a FOnewm only armor. It's good but an Aura Field is easier to find and just as awesome.
Aura Field - My personal late game recommendation. It's a 1/2 chance of dropping from a Mil lilly in EP2. You can combine a Spirit Garment with Magic Rock Moola, but dropped armors usually have better stats than combined items.
Virus Armor:Lafuteria - Only way you'll get this is if you have access to online towers to do the photon drop exchange. Great armor, but the Aura Field is better.
Attribute Wall, or Secret Gear - Shields with great DEF that'll likely last you into ultimate if you really don't care about EVP. The attribute wall is slightly better due to the elemental resistances attached to it. A great PLUS is that every class can wear it as well.
Tripolic Shield - Great addition late game but without access to the towers (or a redria), it might be way too tough to get your hands on.