Ben Affleck has reportedly fled his California home due to the ravaging wildfire in Pacific Palisades ... with best friend Matt Damon, moved to his $20.5 million Palisades mansion following ...