We've fixed Memories of the Forgotten (Part 1 and Part 2), so it won't drop any extra Recovered Memories while taking the quests.
When doing (Daily) Clerical Order: Memories of the Forgotten,...