Documented informed consent of the participant and/or legally authorized representative (brown) * Assent, when appropriate, will be obtained per institutional guidelines * Note: For research participants who do not speak English, a short form consent may be used with a City of Hope (COH) certified interpreter/translator to proceed with screening and leukapheresis, while the request for a translated main consent is processed. However, the research participant is allowed to proceed with lymphodepletion and CAR T cell infusion only after the translated main consent form is signed

Agreement to allow the use of archival tissue from diagnostic tumor biopsies * If unavailable, exceptions may be granted with study principal investigator (PI) approval

Age: \>= 18 years

Eastern Cooperative Oncology Group (ECOG) performance status 0-2 or Karnofsky Performance Status (KPS) \>= 70%

Documented castration resistant prostate cancer (mCRPC) (Note: castration will be defined by a testosterone \< 50 ng/dL achieved by orchiectomy or luteinizing hormone-releasing hormone \[LHRH\] agonist/antagonist therapy) * Documented PSCA+ tumor expression as evaluated by the COH Pathology Clinical Trials Specimen Qualification Laboratory (CTSQL) * Fresh or archival biopsy samples may be tested for PSCA expression during screening for eligibility purposes. The results from soft tissue biopsies will be used to confirm eligibility for participants who have a soft-tissue lesion biopsy obtained, but bone biopsy staining results will not impact eligibility since immunohistochemistry (IHC) staining for PSCA has not been optimized in bone specimens. Subjects who undergo bone biopsy on study will be qualified based on the archival tissue result * Progression of disease manifest by one of the following means during treatment with at least one advanced androgen targeted therapy (e.g., abiraterone or enzalutamide): * Rising prostate specific antigen (PSA) documented on 2 occasions at least 7 days apart, with absolute increase \> 2 ng/dL despite testosterone \< 50 OR * Radiographic evidence of new metastatic foci on CT or bone scan, or soft tissue progression by Response Evaluation Criteria in Solid Tumors (RECIST) * For treatment plan 2, subjects must have at least one and up to 3 metastatic lesions which have not previously been radiated and which is safe for treatment with radiation 16 gray (Gy) in 2 fractions

Fully recovered from the acute toxic effects (except alopecia) to =\< grade 1 to prior anti-cancer therapy

If there has been prior chemotherapy, at least 2 weeks must have elapsed prior to leukapheresis

Prior radiotherapy is allowed provided it was not administered to the only evaluable site of disease and was completed \> 14 days prior to leukapheresis

No known contraindications to leukapheresis, steroids or tocilizumab

Absolute neutrophil count (ANC) \>= 1,000/mm\^3 (within 42 days prior to enrollment) * NOTE: Growth factor is not permitted within 14 days of ANC assessment

Platelets \>= 100,000/mm\^3 (within 42 days prior to enrollment) NOTE: Platelet transfusions are not permitted within 14 days of platelet assessment

Total serum bilirubin =\< 2.0 mg/dL (within 42 days prior to enrollment) * Patients with Gilbert syndrome may be included if their total bilirubin is =\< 3.0 x upper limit of normal (ULN) and direct bilirubin =\< 1.5 x ULN

Aspartate aminotransferase (AST) =\< 2.5 x ULN (within 42 days prior to enrollment)

Alanine aminotransferase (ALT) =\< 2.5 x ULN (within 42 days prior to enrollment)

Creatinine clearance of \>= 50 mL/min per 24 hour urine test or the Cockcroft-Gault formula (within 42 days prior to enrollment)

Corrected QT interval (QTc) =\< 480 ms * Note: to be performed within 28 days prior to day 1 of protocol therapy

Cardiac function (12 lead- electrocardiogram \[ECG\]) without acute abnormalities requiring investigation or intervention (within 42 days prior to enrollment)

Seronegative for human immunodeficiency virus (HIV) antigen (Ag)/antibody (Ab) combo, hepatitis C virus (HCV), active hepatitis B virus (HBV) (surface antigen negative), and syphilis (rapid plasma reagin \[RPR\]) * If positive, hepatitis C ribonucleic acid (RNA) quantitation must be performed OR * If seropositive for HIV, HCV or HBV, nucleic acid quantitation must be performed. Viral load must be undetectable * Note infectious disease testing to be performed within 28 days prior to day 1 of protocol therapy

Meets other institutional and federal requirements for infectious disease titer requirements * Note Infectious disease testing to be performed within 28 days prior to day 1 of protocol therapy

Agreement by males of childbearing potential to use an effective method of birth control or abstain from heterosexual activity for the course of the study through at least 3 months after the last dose of protocol therapy * Childbearing potential defined as not being surgically sterilized

Minimum age: 18

Concurrent use of systemic steroids or chronic use of immunosuppressant medications. Recent or current use of inhaled steroids is not exclusionary. Physiologic replacement of steroids (prednisone =\< 7.5 mg /day, or hydrocortisone =\< 20 mg /day) is allowed

Subjects with clinically significant arrhythmia or arrhythmias not stable on medical management within two weeks of screening

Subjects with a known history or prior diagnosis of optic neuritis or other immunologic or inflammatory disease affecting the central nervous system, including seizure disorder

History of allergic reactions attributed to compounds of similar chemical or biologic composition to study agent

Known bleeding disorders (e.g., von Willebrand's disease) or hemophilia

History of stroke or intracranial hemorrhage within 6 months prior to screening

History of other malignancies, except for malignancy surgically resected (or treated with other modalities) with curative intent, basal cell carcinoma of the skin or localized squamous cell carcinoma of the skin; non-muscle invasive bladder cancer; malignancy treated with curative intent with no known active disease present for \>= 3 years

Clinically significant uncontrolled illness

Active infection requiring antibiotics

Known history of immunodeficiency virus (HIV) or hepatitis B or hepatitis C infection

Any other condition that would, in the Investigator's judgment, contraindicate the patient's participation in the clinical study due to safety concerns with clinical study procedures

Prospective participants who, in the opinion of the investigator, may not be able to comply with all study procedures (including compliance issues related to feasibility/logistics)