Harvey v. Colvin

UNITED STATES DISTRICT COURT
FOR THE DISTRICT OF COLUMBIA
__________________________________
)
OMAR HARVEY, )
)
Plaintiff, )
)
v. ) Civil Action No. 13-1957 (RMC) (DAR)
)
CAROLYN W. COLVIN, )
Acting Commissioner of Social Security, )
)
Defendant. )
_________________________________ )

OPINION

Plaintiff Omar Harvey alleges that Defendant Carolyn Colvin, Acting

Commissioner of Social Security, violated his due process rights at a hearing for reconsideration

of the denial of his Social Security Benefits. The Commissioner moved to dismiss Mr. Harvey’s

suit for failure to exhaust his administrative remedies. The case was referred to Magistrate Judge

Deborah A. Robinson, who recommended denial of the motion to dismiss. The Court concurs

with the recommendation, albeit by way of a different analysis. The Court will adopt in part the

Magistrate Judge’s Report and Recommendation and will deny the Commissioner’s motion to

dismiss.

I. FACTS

A. Proceedings before the Administrative Law Judge

In 2010, Omar Harvey was assaulted by a baseball bat and his right leg bone was

split in half. Am. Compl. [Dkt. 12] ¶ 39. Since the attack, he has had two leg surgeries and now

walks with a cane. Id. Mr. Harvey applied for Social Security Disability Insurance benefits and

Supplemental Security Income benefits in February 2011. Id. ¶ 41. The Social Security

Administration (SSA) denied his application on April 21, 2011. Id. Mr. Harvey requested

1
reconsideration, which was denied, and he then requested a hearing before an Administrative

Law Judge (ALJ). Id. ¶¶ 41-42.

The hearing took place on January 28, 2013 before ALJ Guy B. Arthur. Id. ¶ 42.

Mr. Harvey was represented by Ellie Saadat, whom he had never met prior to the hearing. Id.

¶¶ 43-44. Mr. Harvey alleges that when he arrived at the hearing, he was asked to wait outside

the room while the ALJ and Ms. Saadat spoke privately. Id. ¶ 45. When the hearing began, 1 Ms.

Saadat and the ALJ spoke about the background of Mr. Harvey’s case, including his level of

education, his work history, his injuries, and the fact that Mr. Harvey only had certain medical

records. See Certified Transcript of Hearing Proceedings (Tr.) [Dkt. 14-3] at 1-3. The ALJ then

stated that the hearing could go “off the record just for a minute.” Id. at 3. There is no record of

what was discussed between Ms. Saadat and the ALJ at that time. Id.

Mr. Harvey alleges that before the hearing went back on the record, Ms. Saadat

“came out of the hearing room and told Mr. Harvey that the ALJ stated that there were

insufficient medical records from the year preceding the hearing (2012-2013) to rule in Mr.

Harvey’s favor” and that “the ALJ had advised that the best course of action would be to

withdraw his hearing request.” Am. Compl. ¶¶ 48-49. Apparently, after that conversation, Mr.

1
The transcript is ambiguous as to whether Mr. Harvey was present when the hearing started.
The Court Reporter’s notes state that “[t]he Claimant appeared in person and was represented,”
Tr. at 1, but the ALJ initially referred to Mr. Harvey as a woman, and was corrected by Ms.
Sadaat, id. at 1-2, suggesting that Mr. Harvey was not actually in the courtroom at the time. The
Commissioner argues that the “transcript does not document any movement of anyone into or out
of the hearing room.” Def. Mem. at 6-7. However, this is unsurprising given that much of the
hearing was conducted off the record. The Commissioner also notes that the ALJ spoke directly
to Mr. Harvey, see id., but Mr. Harvey does not dispute that by that point, he had come into the
courtroom.

2
Harvey and Ms. Saadat then went back in the hearing room and an off the record “discussion

then took place between the ALJ, Ms. Saadat, and Mr. Harvey.” Id. ¶ 50. 2

Mr. Harvey alleges that the ALJ stated there was insufficient medical evidence to

rule for Mr. Harvey. Am. Compl. ¶¶ 52. The ALJ told Mr. Harvey that “the best course of

action would be to withdraw his hearing request” and explained that “if Mr. Harvey withdrew his

hearing request, he would have the opportunity for a new hearing where he could present more

medical records.” Id. ¶¶ 57-58. According to Mr. Harvey, the ALJ did not ask him whether he

had records from the 2012-2013 time period or suggest that he get medical records from that

time. Id. ¶¶ 53-54. Nor did the ALJ ask Mr. Harvey questions about his medical conditions, his

symptoms, or his medical treatment. 3 Id. ¶ 55.

When the hearing went back on the record, the ALJ did not make any reference to

what had transpired off the record, but noted that he had before him a motion “tendered by

counsel to withdraw the current hearing request.” Tr. at 3-4. Mr. Harvey’s motion to withdraw

his hearing request is a one page document that contains no statement of the reasons for

withdrawing the request. See Am. Compl., Ex. B [Dkt. 12-2] (Withdrawal of Hearing Request).

The ALJ asked Mr. Harvey whether he made his motion to withdraw “voluntarily

and without coercion” and whether he understood the legal consequences. Tr. at 4. The

transcript reveals that Mr. Harvey replied “Yes (INAUDIBLE).” Id.

2
At some point when Mr. Harvey and Ms. Saadat were back in the hearing room, Ms. Sadaat
told the ALJ that “I haven’t been able to get his signature, but I did explain to him the situation.”
Tr. at 3. The ALJ responded “Do you need a minute or two to talk to him some more? I can step
out of the courtroom. Sir, you can stay right here if you like and just talk to your attorney.” Id.
Then the hearing went off the record again.
3
Mr. Harvey states that he received medical treatment during 2012-2013 but mainly at
emergency rooms rather than primary care doctors because he lacked health insurance. Am.
Compl. ¶ 56. Mr. Harvey states that he had no opportunity to explain this to the ALJ. Id.
3
 The ALJ continued:

[T]his does not preclude you from, in the future, going ahead and
filing. In fact, if once you receive my decision you could
immediately, you know, through counsel turn around and file a new
application using Dr. Robie’s statement, and any other evidence that
you might have. And what you want to do is build a medical record
for yourself, sir, so that there’s documentation. Any judge looking
at it has to find a 12-month continuous period of time medically
documented. And, you know, your attorney has been arguing your
case, but she can only do the best she can within the record that’s
provided to her, all right?

Tr. at 4. After that, the hearing was concluded. Id. at 4-5.

The next day, January 29, 2013, the ALJ issued a notice and order dismissing Mr.

Harvey’s hearing request. See Am. Compl., Ex. C [Dkt. 12-3] (Notice and Order of Dismissal).

Mr. Harvey subsequently received a letter from Ms. Saadat’s office stating that he was no longer

represented. Am. Compl. ¶ 77. Mr. Harvey filed a pro se request for review of the dismissal of

his hearing request and his request was denied by the SSA Appeals Council on August 9, 2013.

See Am. Compl., Ex. D [Dkt. 12-4] (Notice of Appeal Council Action).

B. SSA Regulations and Guidelines

SSA issues policy guidelines regarding claims for benefits in its Hearings. See

Appeals and Litigation Law Manual (HALLEX) and the Program Operations Manual System

(POMS). 4 The POMS states that withdrawal of hearing requests made in writing or orally must

include a statement of reasons for requesting withdrawal, and a statement that the claimant

understands the effect of the request. POMS SI 04030.020.A(4)(a). The POMS gives the ALJ

4
The POMS regarding Supplemental Security Income (SI) is available at
https://secure.ssa.gov/apps10/poms.nsf/chapterlist!openview&restricttocategory=05 (last visited
June 26, 2015). The HALLEX Manual is available at
http://ssa.gov/OP_Home/hallex/hallex.html (last visited June 26, 2015).

4
authority to refuse to approve a withdrawal request if the ALJ “believes that the appellant did not

understand the consequences of a withdrawal.” Id. at (4)(b).

The HALLEX Manual “communicates . . . guiding principles and procedures” to

the staff of the Office of Disability Adjudication and Review (ODAR) staff, including

“adjudicators. i.e., administrative law judges.” HALLEX 1-1-0-3. It requires that, before an

ALJ can dismiss a request for a hearing following a claimant’s voluntary withdrawal, the “record

[must] show[ ] that the claimant understands the effects of withdrawal (i.e., that the ALJ will

dismiss the [hearing request] and the dismissal will be binding unless it is vacated by the ALJ or

the Appeals Council).” Id. at I-2-4-20(A)(2).

SSA regulations require an ALJ to “make a complete record of the hearing

proceedings.” 20 C.F.R. §§ 404.951, 416.1451. The HALLEX manual further provides that

“[i]f a question arises during the course of a hearing that is not relevant to the issues in the

claimant’s case, the ALJ may decide to discuss and resolve it off-the-record. However, the ALJ

must summarize on the record the content and conclusion of any off-the-record discussion.”

HALLEX 1-2-640.

C. Procedural Background

Mr. Harvey filed a Complaint in this Court on December 9, 2013, and amended

his Complaint on March 23, 2014. In the Amended Complaint, Mr. Harvey alleges that the ALJ

violated his right to due process; specifically, he claims that the ALJ deprived him of meaningful

notice and the opportunity to be heard; failed to comply with his duty to inquire fully into all

relevant facts and medical evidence in Mr. Harvey’s case before suggesting that he withdraw his

hearing request; gave him inaccurate information and failed to apprise him adequately of the

consequences of withdrawing his hearing request; and allowed substantive conversations about the

merits of his case to occur outside his presence and with the hearing recording turned off (thereby

5
making judicial review impossible). Am. Compl. ¶ 85. Mr. Harvey further alleges that the ALJ

violated specific SSA regulations by (1) dismissing Mr. Harvey’s hearing request without ensuring

that the record reflected that Mr. Harvey understood the consequences of doing so; (2) failing to

obtain a statement from Mr. Harvey, orally or in writing, about why he wished to withdraw his

hearing request; and (3) failing to record or summarize all discussions that took place during Mr.

Harvey’s hearing. Id. ¶¶ 87-89. In support of his Amended Complaint, Mr. Harvey attached four

exhibits: (1) an informal hearing transcript, prepared by counsel based on the recording of the

hearing provided by the Social Security Administration; (2) Mr. Harvey’s signed “Withdrawal of

Hearing Request” form; (3) SSA’s Notice of Dismissal of Mr. Harvey’s request for a hearing; and

(4) SSA’s Notice of Appeals Council Action, denying Mr. Harvey’s request for review of the

dismissal of his request for a hearing.

In response, the Commissioner moved to dismiss Mr. Harvey’s Amended

Complaint on the ground that he had not exhausted his administrative remedies. See Mot. to

Dismiss [Dkt. 13]; Mem. in Support of Def. Mot. to Dismiss (Def. Mem.) [Dkt. 14] at 1. 5 The

Commissioner further argued that Mr. Harvey had not alleged any permissible basis for waiver

of the exhaustion requirement, such as “where the plaintiff raises a challenge wholly collateral to

his claim for benefits and makes a colorable showing that his injury could not be remedied by the

retroactive payment of benefits.” Def. Mem. at 5-6. The Commissioner insisted that Mr. Harvey

was not deprived of meaningful notice, that he was represented by an attorney, that he

voluntarily requested the dismissal, and confirmed he understood the legal consequences of the

5
The Commissioner’s motion is labeled as a “Motion to Dismiss the Amended Complaint For
Lack of Subject Matter Jurisdiction” but asserts that the complaint should be dismissed for
failure to state a claim under Federal Rule of Civil Procedure 12(b)(6). Mot. to Dismiss. The
memorandum in support of the motion to dismiss asserts that the Amended Complaint should be
dismissed for lack of subject matter jurisdiction because Mr. Harvey did not exhaust his
administrative remedies. Def. Mem. at 1.

6
dismissal. Id. at 6-8. Mr. Harvey opposed the motion to dismiss, arguing that because he had

presented a colorable constitutional claim that the ALJ denied him a hearing in violation of his

due process rights, the exhaustion requirements should be waived and the motion to dismiss

denied. See Pl. Opp. to Def. Motion to Dismiss (Pl. Opp.) [Dkt. 15].

On June 3, 2014, the Court referred this case to Magistrate Judge Deborah A.

Robinson for a Report and Recommendation (R&R). Minute Order dated 6/3/14. On March 12,

2015, Magistrate Judge Robinson issued an R&R, analyzing the Commissioner’s motion to

dismiss under Rule 12(b)(6). R&R [Dkt. 18] at 2. She noted that because the Commissioner

styled the motion as one to dismiss for lack of subject matter jurisdiction but also moved

pursuant to Rule 12(b)(6), “the undersigned considers the . . . motion in accordance with the

precedent governing motions made pursuant to the subsection of the Rule on which the

Commissioner actually relies.” Id. at 2 n.1.

Magistrate Judge Robinson stated that the Commissioner offered three exhibits in

support of her motion: (1) the declaration of Patrick Herbst, chief of a branch of the SSA’s

Office of Disability Adjudication and Review (Herbst Declaration); (2) the notice of dismissal of

Mr. Harvey’s request for a hearing, and (3) the order of dismissal of Mr. Harvey’s request for a

hearing and notice of Appeals Council action. Id. at 2-3. 6 Finding that the Commissioner

“principally relie[d]” on the Herbst Declaration, Magistrate Judge Robinson concluded that she

had “no alternative” but to recommend denial of the Commissioner’s motion because Rule 12 of

the Federal Rules makes plain that “[i]f on a motion under Rule 12(b)(6) . . . matters outside the

pleadings are presented to and not excluded by the court, the motion must be treated as one for

6
As discussed infra, although not noted by Magistrate Judge Robinson, the Commissioner also
attached an official copy of the transcript of Mr. Harvey’s hearing before the ALJ. See Tr. [Dkt.
14-3].

7
summary judgment under Rule 56[,] [and] [a]ll parties must be given a reasonable opportunity to

present all the material that is pertinent to the motion.” Id. at 3 (quoting Fed. R. Civ. P. 12(d)).

Magistrate Judge Robinson was “mindful that Plaintiff [did] not oppose the

Commissioner’s motion on the ground that he [had] not yet had an opportunity to present

evidence in opposition,” but found that the Commissioner did not address Plaintiff’s allegation

that the ALJ violated due process by preventing Mr. Harvey from obtaining the very hearing on

which exhaustion depends, thus frustrating “the adversarial process for sharpening the issues for

decision.” Id. at 4 (quoting Coleman through Bunn v. Dist. of Columbia, Civil Action No. 13-

1456, 2014 WL 19092, at *17 (D.D.C. Sept. 30, 2014)). Magistrate Judge Robinson concluded

that “‘a reasonable opportunity to contest the matters outside the pleadings’ includes both an

opportunity for discovery, and a more thorough briefing of the exhaustion issue in accordance

with the Federal Rules,” and recommended denial of the motion to dismiss. Id. at 4-5.

The Commissioner timely filed her objections to the R&R on March 26, 2015.

See Def. Objections to R&R (Def. Obj.) [Dkt. 19]. First, the Commissioner complains that the

R&R erroneously considered the motion to dismiss under Federal Rule of Civil Procedure

12(b)(6), instead of construing it as a motion to dismiss for lack of subject matter jurisdiction

under Rule 12(b)(1). Second, the Commissioner argues that, in any event, the motion to dismiss

passes muster under Rule 12(b)(6) because “there are no substantive matters here that are truly

outside the pleadings.” Id. at 2. Third, the Commissioner objects to the R&R’s finding that the

motion to dismiss failed to address Mr. Harvey’s contention that the ALJ prevented him from

exhausting his administrative remedies. Fourth, the Commissioner contends that Magistrate

Judge Robinson incorrectly concluded that she could not convert the motion to one for summary

judgement because the parties were entitled to present evidence before such a ruling, including

8
discovery and more thorough briefing of the exhaustion issue. Mr. Harvey responded to these

objections urging the Court to adopt the R&R. See Pl. Resp. [Dkt. 21]. 7

II. LEGAL STANDARDS

A. Report and Recommendation

Rule 72(b) of the Federal Rules of Civil Procedure sets forth the procedure for

review of dispositive motions that have been referred to a magistrate judge for a Report and

Recommendation (R&R). Any party may file objections to the proposed findings and

recommendations and the district judge “must determine de novo any part of the magistrate

judge’s disposition that has been properly objected to.” Fed. R. Civ. P. 72(b). “The district

judge may accept, reject, or modify the recommended disposition; receive further evidence; or

return the matter to the magistrate judge with instructions.” Id.

B. Motion to Dismiss

A motion to dismiss pursuant to Federal Rule of Civil Procedure 12(b)(6)

challenges the adequacy of a complaint on its face, testing whether a plaintiff has properly stated

a claim. Fed. R. Civ. P. 12(b)(6). Although a complaint does not need detailed factual

allegations, a plaintiff’s obligation to provide the grounds of his entitlement to relief “requires

more than labels and conclusions, and a formulaic recitation of the elements of a cause of action

will not do.” Bell Atl. Corp. v. Twombly, 550 U.S. 544, 555 (2007). The facts alleged “must be

enough to raise a right to relief above the speculative level.” Id.

In considering a motion to dismiss under Rule 12(b)(6), the Court must construe

the complaint liberally in favor of the plaintiff, granting him “the benefit of all inferences that

7
Mr. Harvey also filed a motion requesting referral to the Court’s mediation program [Dkt. 22],
which the Commissioner opposes [Dkt. 23]. The Court will deny the motion at this time without
prejudice.

9
can be derived from the facts alleged.” Kowal v. MCI Commc’ns Corp., 16 F.3d 1271, 1276, 305

U.S. App. D.C. 60 (D.C. Cir. 1994). Still, the Court need not accept inferences drawn by the

plaintiff if those inferences are unsupported by facts alleged in the complaint, nor must the Court

accept plaintiff’s legal conclusions. See id.; Browning v. Clinton, 292 F.3d 235, 242 (D.C. Cir.

2002). “Threadbare recitals of the elements of a cause of action, supported by mere conclusory

statements, do not suffice.” Ashcroft v. Iqbal, 556 U.S. 662, 678 (2009). “While legal

conclusions can provide the framework of a complaint, they must be supported by factual

allegations. When there are well-pleaded factual allegations, a court should assume their veracity

and then determine whether they plausibly give rise to an entitlement to relief.” Id. at 679.

In ruling upon a motion to dismiss for failure to state a claim, the court is limited

to considering the facts alleged in the complaint, any documents attached to or incorporated in

the complaint, matters of which the court may take judicial notice, and matters of public record.

See Abhe & Svoboda, Inc. v. Chao, 508 F.3d 1052, 1059 (D.C. Cir. 2007); Kaempe v. Myers, 367

F.3d 958, 965 (D.C. Cir. 2004). If a district court refers to materials outside the pleadings in

resolving a 12(b)(6) motion, it must convert the motion to dismiss into one for summary

judgment. Fed. R. Civ. P. 12(d); see also Wiley v. Glassman, 511 F.3d 151, 160 (D.C. Cir.

2007); Wright & Miller § 1277. “In converting the motion, district courts must provide the

parties with notice and an opportunity to present evidence in support of their respective

positions.” Kim v. United States, 632 F.3d 713, 719 (D.C. Cir. 2011); Fed. R. Civ. P. 12(d), 56.

III. ANALYSIS

The Commissioner first argues that the R&R erroneously applied Federal Rule of

Civil Procedure 12(b)(6) to her motion to dismiss, instead of considering it under Rule 12(b)(1).

While acknowledging that the motion to dismiss incorrectly cited Rule 12(b)(6), the

Commissioner argues that this mistake should not negate the substance of the motion, which
10
argued the lack of subject matter jurisdiction. The Court disagrees that the motion was proper

under 12(b)(1), albeit for different reasons than Magistrate Judge Robinson. 8 In her motion to

dismiss, the Commissioner maintained that Mr. Harvey did not exhaust his administrative

remedies because he did not have a hearing; 9 such a motion is more properly construed as a

motion to dismiss for failure to state a claim. While the D.C. Circuit has not explicitly opined on

the question, courts in this Circuit tend to treat failure to exhaust or to show waiver of exhaustion

of administrative remedies, “‘as a failure to state a claim rather than as a jurisdictional

deficiency.’” 10 Beattie v. Astrue, 845 F. Supp. 2d 184, 191 (D.D.C. 2012) (quoting Ly v. U.S.

8
Magistrate Judge Robinson stated that: “Defendant styles the motion a motion to dismiss ‘for
Lack of Subject Matter Jurisdiction[.]’ However, as Defendant moves pursuant to Rule 12(b)(6)
of the Federal Rules of Civil Procedure—which provides for dismissal of a complaint for failure
to state upon which relief can be granted—rather than Rule 12(b)(1)—which provides for
dismissal of a complaint for lack of jurisdiction over the subject matter—the undersigned
considers the pending motion in accordance with the precedent governing motions made
pursuant to the subsection of the Rule on which Defendant actually relies.” R&R at 2 n.1.
9
In order to exhaust administrative remedies under the Social Security Act, a claimant must have
received (1) an initial determination regarding his claim for benefits, (2) reconsideration, (3) a
hearing before an administrative law judge and, finally, (4) Appeals Council review. 20 C.F.R.
§ 404.900(a)(1). Under 42 USC § 405(g), “[a]ny individual, after any final decision of the
Commissioner of Social Security made after a hearing to which he was a party” may obtain
judicial review of such decision. Courts have found a failure to exhaust when no hearing occurs
because a claimant withdrew his request. Beattie v. Astrue, 845 F. Supp. 2d 184, 189 n.9
(D.D.C. 2012) (“Because [Plaintiff] withdrew his request, no hearing was held and no final
decision ever issued.); see also Hoye v. Sullivan, 985 F.2d 990, 991 (9th Cir. 1992) (finding that
when a plaintiff “waived his opportunity for a hearing,” “he failed to exhaust the administrative
remedy upon which judicial review depends”).
10
“The Supreme Court has construed 42 U.S.C. § 405(g) as having jurisdictional and non-
jurisdictional exhaustion components. The requirement that a plaintiff must first present his
claim to the agency is jurisdictional and cannot be waived, while the requirement that the
plaintiff must complete the agency review process is non-jurisdictional and may be waived.”
Cost v. SSA, 770 F. Supp. 2d 45, 48 (D.D.C. 2011) (citing Shalala v. Ill. Council on Long Term
Care, Inc., 529 U.S. 1, 23 (2000)). “A motion to dismiss under Rule 12(b)(1) for lack of subject
matter jurisdiction is inappropriate where a defendant claims that a plaintiff failed to comply
with only the non-jurisdictional exhaustion requirement [rather than the presentment
requirement].” Id.

11
Postal Serv., 775 F. Supp. 2d 9, 11 (D.D.C. 2011)); Hall v. Sebelius, 689 F. Supp. 2d 10, 21

(D.D.C. 2009) (while “[t]here is some uncertainty regarding whether a failure to exhaust

administrative remedies is properly brought in a Rule 12(b)(1) motion, as a jurisdictional defect,

or in a Rule 12(b)(6) motion for failure to state a claim . . . . [t]he recent trend in this District . . .

is to treat failure to exhaust as a failure to state a claim rather than as a jurisdictional deficiency”)

(citing cases); but see Jones v. United States, 813 F. Supp. 2d 210, 214 (D.D.C. 2011) (granting

motion to dismiss for failure to exhaust under Rule 12(b)(1)). Accordingly, the Court considers

the Commissioner’s motion to dismiss as one for failure to state a claim upon which relief can be

granted.

Having determined that the motion to dismiss must be evaluated under Rule

12(b)(6), the Court turns to the Commissioner’s argument that Magistrate Judge Robinson

improperly denied the motion on the ground that the Commissioner submitted materials outside

the pleadings. Def. Obj. at 2. The Commissioner explains that, contrary to the R&R’s finding,

the motion to dismiss did not principally rely on the Herbst Declaration; rather, the Declaration

was merely a “procedural vehicle containing no substantive information that is not already

contained in the exhibits themselves (the two notices and the hearing transcript) that both parties

submitted to the court.” Def. Obj. at 4. According to the Commissioner, “the [D]eclaration

serves primarily to establish that these substantive exhibits are authentic documents that

originated from Plaintiff’s claims file—a fact that Plaintiff does not challenge.” Id.

The Court concludes that the R&R could have considered the motion to dismiss

under 12(b)(6) despite the attached three-page Herbst declaration explaining SSA’s appellate

review procedures and certifying the relevant SSA documents in Mr. Harvey’s case (all of which

were also attached to Mr. Harvey’s Complaint). See Herbst Declaration [Dkt. 14-1]. Federal

12
Rule of Civil Procedure 12(d) states that “[i]f on a motion under Rule 12(b)(6) or 12(c), matters

outside the pleadings are presented to and not excluded by the court, the motion must be treated

as one for summary judgment under Rule 56.” Fed. R. Civ. P. 12(d). But just because the

Herbst Declaration was “presented” with the Commissioner’s motion to dismiss did not

automatically require conversion to summary judgment. The law of this Circuit makes clear that

conversion of a motion to dismiss to one for summary judgment is only required when the

district court “refer[s] to materials outside the pleadings in resolving a 12(b)(6) motion.” Kim,

632 F.3d at 719 (emphasis added); see also Ruffin v. Gray, 443 Fed. Appx. 562, 563-564 (D.C.

Cir. 2011) (finding that even though district court did not expressly exclude attachments to both

a motion to dismiss and a response, it did not err in failing to convert the motion to dismiss to a

summary judgment motion because it only considered items listed in Rule 12(b)(6)); McKinney

v. Dole, 765 F.2d 1129, 1134 (D.C. Cir. 1985) (conversion required under Rule 12(d) only where

“[d]istrict [c]ourt considered materials outside the pleadings in dismissing the case”), abrogated

on other ground by Stevens v. Department of Treasury, 500 U.S. 1 (1991). Here, there is no need

to consider the Herbst Declaration in deciding the motion to dismiss and, accordingly, there is no

need to convert the motion to one for summary judgment.

Nonetheless, the Court agrees with the R&R’s recommendation to deny the

Commissioner’s motion to dismiss. The Court finds that Mr. Harvey has alleged facts

supporting his claim that he should be excused from prior exhaustion of his administrative

remedies because he raises a colorable constitutional challenge to the very conduct that

prevented him from achieving exhaustion.

As noted above, to exhaust administrative remedies under the Social Security Act,

a claimant must have received (1) an initial determination regarding his claim for benefits, (2)

13
reconsideration, (3) a hearing before an ALJ and, finally, (4) Appeals Council review. 20 C.F.R.

§ 404.900(a)(1). A district court may relieve a claimant from SSA’s exhaustion requirement

when he makes a colorable constitutional challenge that is collateral to any claim for benefits.

Mathews v. Eldridge, 424 U.S. 319, 329-31 (1976); Califano v. Sanders, 430 U.S. 99, 109 (U.S.

1977) (finding that claimant alleging a colorable constitutional claim could bring suit in federal

court despite lacking a “final decision of the Secretary made after a hearing”). A constitutional

claim is “colorable” so long as it is not “wholly insubstantial, immaterial or frivolous.” Vencor

Nursing Ctrs, L.P. v. Shalala, 63 F. Supp. 2d 1, 5 (D.D.C. 1999) (quoting Boettcher v. HHS, 759

F.2d 719, 722 (9th Cir. 1985)); Hoye v. Sullivan, 985 F.2d 990, 991-02 (9th Cir. 1992) (“A

constitutional claim is not colorable if it clearly appears to be immaterial and made solely for the

purpose of obtaining jurisdiction or . . . is wholly insubstantial or frivolous.” (internal quotations

omitted)). 11

11
Certain courts in this district have quoted a Ninth Circuit case for the proposition that “the
mere allegation of a due process violation is insufficient to raise a colorable constitutional claim
that will provide the Court with subject-matter jurisdiction.” See Maiden v. Barnhart, 450 F.
Supp. 2d 1, 4 (D.D.C. 2006) (quoting Hoye, 985 F.2d at 992); Beattie, 845 F. Supp. 2d at 193
(quoting Maiden, 450 F. Supp. 2d at 4) and Harris v. Sebelius, 932 F. Supp. 2d 150, 152 (D.D.C.
2013) (same). “[I]f jurisdiction were to be sustained by mere allegations of denials of due
process, ‘every disappointed claimant could raise such a due process claim, thereby undermining
a statutory scheme designed to limit judicial review.’” Hoye, 985 F.2d at 992 (quoting Holloway
v. Schweiker, 724 F.2d 1102, 1105 (4th Cir. 1984)). Hoye explained that the plaintiff did not
raise a colorable substantive due process challenge because his sole allegation was “that the ALJ
arbitrarily and capriciously dismissed his request for a hearing because the ALJ was biased
against his attorney” and “[i]f the mere allegation of a denial of due process can suffice to
establish subject-matter jurisdiction, then every decision of the Secretary would be [judicially]
reviewable by the inclusion of the [magic] words’ ‘arbitrary’ or ‘capricious.’” Id. at 992
(quoting Robertson v. Bowen, 803 F.2d 808, 810 (5th Cir. 1986)). Those concerns are not
present here and Mr. Harvey’s case is distinguishable from Hoye because his due process claim
surpasses the threshold of colorability. The facts as alleged in his Amended Complaint establish
more than a bare, unsupported allegation of a due process violation and his claim is not
immaterial, insubstantial or frivolous.

14
 Mr. Harvey does not dispute that he failed to exhaust his administrative remedies

because he did not have a hearing before an ALJ on the denial of his claim for benefits.

However, Mr. Harvey alleges the exhaustion requirement should be waived because of his

colorable due process claim. Specifically, Mr. Harvey alleges that: (1) the ALJ denied him the

opportunity to be heard because the ALJ recommended withdrawal before giving him the

opportunity to present evidence or testimony about his medical history; (2) the ALJ violated due

process protections by failing to inform Mr. Harvey of the adverse consequences of withdrawing

his hearing request; and (3) the ALJ denied him the right to be present throughout the

proceedings by excluding him from key discussions with counsel about the merits of his case and

failing to record or summarize those key discussions. Pl. Opp. at 7-8.

As an initial matter, Mr. Harvey has shown that his challenge is “collateral to his

substantive claim of entitlement . . . .” Matthews, 424 U.S. at 330. Mr. Harvey does not seek a

reversal of the Commissioner’s decision to deny him benefits, but requests remand of his case to

the agency so that it can determine whether an award of benefits is warranted. Other Circuits

have held such claims to be collateral to a substantive claim for benefits when, as here, the

plaintiffs “would not automatically be entitled to receive benefits if they prevail, but only to

receive ‘the procedure they should have been accorded in the first place.’” Day v. Shalala, 23

F.3d 1052, 1059 (6th Cir. 1994) (quoting Bowen v. City of New York, 476 U.S. 467, 484 (1986));

see also Schoolcraft v. Sullivan, 971 F.2d 81, 86 (8th Cir. 1992); Marcus v. Sullivan, 926 F.2d

604, 614 (7th Cir. 1991); State of New York v. Sullivan, 906 F.2d 910, 918 (2d Cir. 1990); Hyatt

v. Heckler, 807 F.2d 376, 379-380 (4th Cir. 1986). Mr. Harvey’s due process claim is collateral

to his demand for benefits because he alleges the due process violations caused his demand to be

denied. Beattie, 845 F. Supp. 2d at 192.

15
 The Court also finds that, for the purposes of a motion to dismiss, Mr. Harvey has

pled facts sufficient to allege colorable due process violations. See, e.g., Thorbus v. Bowen, 848

F.2d 901, 903 (8th Cir. 1988) (assuming without deciding that plaintiff’s constitutional claim—

denial of due process because he was excluded from Medicare without notice or a hearing—was

“sufficiently colorable” despite facts that were “marginal to support a colorable claim”). To

start, considering the lack of a full transcript of Mr. Harvey’s hearing, and construing Mr.

Harvey’s allegations in the light most favorable to him as the Court is required to do on a motion

to dismiss, Mr. Harvey sufficiently pleads a colorable due process claim that the ALJ failed to

develop a comprehensive record for a full and fair hearing. See Am. Compl. ¶¶ 52, 56, 57

(alleging that ALJ suggested Mr. Harvey withdraw hearing request because of insufficient

medical record and that ALJ failed to provide opportunity to explain that he had received

treatment in relevant time frame).

An ALJ “has the power and duty to investigate fully all matters in issue, and to

develop the comprehensive record required for a fair determination of disability.” Diabo v.

Secretary of Health, Education & Welfare, 627 F.2d 278, 281 (D.C. Cir. 1980). Here, Mr.

Harvey alleges that he had received medical treatment in the year 2012-2013 but had mainly

been treated in emergency rooms rather than by primary care doctors because he lacked health

insurance. Am. Compl. ¶ 56. However, instead of inquiring whether Mr. Harvey had additional

records, the ALJ simply told Mr. Harvey that a judge looking at his record “has to find a 12-

month continuous period of time medically documented” and that the attorney “can only do the

best she can within the record that’s provided to her.” Tr. at 4. 12 But Mr. Harvey was given no

12
It is possible that the ALJ did conduct such an inquiry, but the Court cannot make such a
finding because no such investigation is set forth or is summarized in the transcript.

16
opportunity to explain that he had received medical treatment during the relevant time frame. 13

If he had been given such an opportunity, the ALJ could have kept the record open for the

submission of additional medical evidence or continued the hearing to a later date on the ground that

material evidence was believed to be missing, both of which are permitted by agency regulations.

See, e.g., 20 C.F.R. § 404.944. Indeed, Mr. Harvey seems to have been under the impression that the

ALJ was in fact continuing the hearing; according to Mr. Harvey, he was told by the ALJ that if he

withdrew his hearing request, he would get a new hearing where he could present additional

medical records. Am. Compl. ¶¶ 57, 58, 72, 73. Perhaps there were interactions off the record

that might undermine Mr. Harvey’s allegations about his medical history, but based on the scant

evidence before it, the Court cannot disregard the allegations pled in the Complaint.

Furthermore, the Court cannot accept the Commissioner’s argument that the ALJ was under no

obligation to inquire into Mr. Harvey’s medical history and that “it would have been

inappropriate for him to do so[ ] once it became clear that Plaintiff did not wish to proceed with a

hearing on the merits of his claim.” Def. Mem. at 7. The transcript of the hearing does not

reveal any indication of Mr. Harvey “not wishing to proceed” until the end of the hearing, when

the ALJ had before him a signed withdrawal request (by which point Mr. Harvey alleges, he had

already been told that he would have an additional hearing). Thus, to the extent shown by the

record, there was no full consideration of whether there was medical evidence to support Mr.

Harvey’s claim.

Mr. Harvey also asserts that the ALJ failed to provide adequate notice of the

impact of his decision to withdraw. The transcript reveals that the ALJ asked Mr. Harvey if he

13
Mr. Harvey does not argue that he currently has other medical records but states that he
received medical treatment in the year 2012-2013. Am. Compl. ¶ 56. This allegation is sufficient
on a motion to dismiss to support his claim that he was denied a meaningful opportunity to be heard.

17
were withdrawing his hearing request “voluntarily and without coercion” and if he understood

the legal consequences of his withdrawal, Tr. at 4, but the ALJ provided no explanation as to

what those legal consequences were. Taking Mr. Harvey’s allegations as true—that he was

advised that he would have another hearing to present evidence and was not advised that his

withdrawal would finalize his appeal process—the Court finds that Mr. Harvey pleads a due

process violation of insufficient notice, which survives a motion to dismiss. See, e.g.,

Loudermilk v. Barnhart, 290 F.3d 1265, 1269 (11th Cir. 2002) (finding notice advising claimants

of rights defective because claimants were not properly apprised of res judicata effect of filing

new petition rather than appealing the initial, negative decision).

In accepting the withdrawal request, the ALJ stated that the request “does not

preclude you from, in the future, going ahead and filing . . . . a new application” and told Mr.

Harvey to “build a medical record.” Tr. at 4. However, he did not explain that the only way to

get a new hearing was by filing a “new application.” Thus, it is understandable, given that Mr.

Harvey was allegedly told he would have a new hearing to present evidence, that Mr. Harvey

thought that his hearing date would be rescheduled to another day after he had a chance to get

more medical records, and that his appeal was still alive. See Am. Compl. ¶¶ 57, 58, 71-74. The

ALJ also failed to note that the decision to withdraw would be the end of Mr. Harvey’s appeal

and that even if he reapplied he would only get benefits back to the date of his new application

and not back to the date of the initial application, both of which could have alerted Mr. Harvey to

the fact that this decision was final.

Moreover, the ALJ acted in violation of the POMS and HALLEX guidelines in

failing to ensure that Mr. Harvey’s withdrawal included a statement of reasons as to why he

wished to withdraw his hearing request, see 20 C.F.R. §§ 404.957, 416.1457; POMS SI

18
04030.020.A(4)(a), and failing to confirm that Mr. Harvey understood the effects his withdrawal

request “i.e., that the ALJ will dismiss the [request] and the dismissal will be binding,”

HALLEX I-2-4-20(A)(2). There is no indication that the ALJ took these steps off the record and

the ALJ did not summarize or record the content of any off-the-record conversations that took

place during the hearing. See 20 C.F.R. §§ 404.95 1, 416.1451; HALLEX 1-2-640. Even though

these agency manuals do not have the force of law, “most courts have treated the POMS as

interpretive rules entitled to deference at the lower level established in Skidmore v. Swift &

Company[, 323 U.S. 134 (1944)].” Hall v. Sebelius, 689 F. Supp. 2d 10, 21 (D.D.C. 2009); see

also Wash. State Dept. of Soc. and Health Servs. v. Guardianship Estate of Wash. State Dept. of

Soc. and Health Servs., 537 U.S. 371, 385 (2003) (While “administrative interpretations are not

products of formal rulemaking, they nevertheless warrant respect” and are entitled to Skidmore

deference.). Indeed, while not dispositive, failure to abide by agency regulations is a factor

weighing in favor of finding a colorable due process violation. See, e.g., Dexter v. Colvin, 731

F.3d 977, 981-82 (9th Cir. 2013) (finding due process violation where ALJ failed to follow

regulations while noting that not every failure would necessarily rise to that level).

Finally, Mr. Harvey claims that the ALJ violated his right to be present at the

hearing by excluding him from substantive off-the-record discussions about his case. Claimants

have a due process right to attend SSA hearings. See Stoner v. Secretary of Health & Human

Services, 837 F.2d 759, 760-61 (6th Cir. 1988) (finding that claimant was denied due process

rights when hearing was conducted in his absence and he was represented by attorney); see also

HALLEX 1-2-6-60(C) (noting that the claimant must agree before being excused from the

hearing room, even where the representative remains). The transcript is ambiguous as to whether

Mr. Harvey was present for the entire hearing (see supra n.1), but on a motion to dismiss, the

19
Court is obligated to accept Mr. Harvey’s claims as alleged: that he was forced to wait outside

the hearing room while the ALJ spoke to his lawyer and his lawyer then relayed to him the

substance of her conversation with the ALJ, in which the ALJ stated that there were insufficient

medical records and that the ALJ thought Mr. Harvey should withdraw his hearing request. Am.

Compl. ¶¶ 45, 48, 49. Also troublesome to the Court is the fact that substantive discussions

appear to have taken place off the record, in violation of agency regulations, which again weighs

in favor of finding a due process violation. See Betancourt v. Astrue, 824 F. Supp. 2d 211, 217

(D. Mass. 2011) (finding due process violation where ALJ engaged in off-the-record discussions

with claimant and claimant felt pressured to proceed without full hearing). The Commissioner

describes Mr. Harvey’s claims as “unsubstantiated” and “unverifiable,” but of course the reason

why the facts alleged by Mr. Harvey cannot be confirmed or denied by the record is a result of

the very conduct complained about—i.e., that the ALJ, in violation of SSA regulations, directed

that portions of the hearing be held off the record “thereby making it impossible for [Mr.

Harvey] to corroborate his own account of what occurred.” Pl. Opp. at 1. Cf. Beattie, 845 F.

Supp. 2d at 193 (finding no colorable constitutional claim after reviewing hearing transcript and

concluding that plaintiff’s allegations of misconduct by ALJ were unsupported and belied by

administrative record).

As Magistrate Judge Robinson found, the Commissioner’s motion to dismiss does

not sufficiently address Mr. Harvey’s due process allegations, a finding to which the

Commissioner objects. The Commissioner claims that there is no violation because “Plaintiff

chose to withdraw his request for hearing, and the ALJ accommodated that request” and that

“Plaintiff himself requested the dismissal.” Def. Obj. at 5. The problem with these assertions is

that it is simply impossible to tell from the transcript whether Mr. Harvey had an opportunity to

20
explain his medical history, whether he was counseled about the adverse consequences of his

withdrawal request, and whether he was prevented from participating in substantive discussions

at the hearing—all of which Mr. Harvey alleges failed to happen. In arguing that Mr. Harvey’s

claims are unsupported, the Commissioner does not contradict Mr. Harvey’s version of events,

nor does she present any affidavits or counterstatements of fact that might support her

arguments. 14

Mr. Harvey also meets the three-part showing required to waive the

administrative exhaustion requirement. “A court may waive the exhaustion requirements of

§ 405(g) when: (1) the issue raised is entirely collateral to a claim for payment; (2) plaintiffs

show they would be irreparably injured were the exhaustion requirement enforced against them;

and (3) exhaustion would be futile.” Triad at Jeffersonville I, LLC v. Leavitt, 563 F. Supp. 2d 1,

16 (D.D.C. 2008) (citing Bowen, 476 U.S. at 483-85). As discussed above, the relief sought by

Mr. Harvey is collateral to his substantive claim for benefits. He has also alleged irreparable

injury: if judicial review is unavailable to him because of his failure to exhaust, he has no way to

challenge the dismissal of his hearing request. While Mr. Harvey can reapply for benefits, that

application, if granted, would only entitle Mr. Harvey to retroactive benefits from the date of his

new application, and he would never be able to collect benefits from the date of his initial

February 2011 application. See POMS SI 04030.020.A (determination about denial of benefits is

14
Citing no case law, the Commissioner makes two further arguments that Mr. Harvey’s due
process rights were not violated. Def. Obj. at 5. First, the Commissioner contends no violation
occurred because Mr. Harvey was represented by an attorney who was present at the hearing.
But the presence of a lawyer does not protect against all due process violations. See Stoner, 837
F.2d at 760-61; Betancourt, 824 F. Supp. 2d at 216-17. Second, the Commissioner argues that
“there is no evidence that Plaintiff has a mental impairment that would prevent him from
understanding the consequences of the ALJ granting his request.” Id. This argument misses the
mark. The ALJ failed to make a record here—not Mr. Harvey—and the absence of a record
leaves Mr. Harvey’s allegations factually uncontroverted.

21
final if ALJ dismissed hearing request). Mr. Harvey would also be deprived of income during

the pendency of any new application.

Finally, to require exhaustion would be futile here. Mr. Harvey has failed to

exhaust because he did not have a hearing, but there is no way for Mr. Harvey to correct that

deficiency. He has already sought review of the dismissal of his hearing request. Indeed, the

relief that Mr. Harvey is seeking here—a hearing—is the very procedure required to satisfy the

exhaustion requirement. Thus, because Mr. Harvey “has pursued every available administrative

avenue to overturn the dismissal” of his hearing request and that decision is final, it would be

futile to require Mr. Harvey to exhaust his administrative remedies. Howard v. Heckler, 661 F.

Supp. 654, 656 (N.D. Ill. 1986). Indeed, “[l]ogic and common sense dictate that in a case such

as this, where the claim is a constitutional one, future exhaustion would not merely be futile for

the applicant but would also be a commitment of administrative resources unsupported by any

judicial interest.” Ellison v. Califano, 546 F.2d 1162, 1164-65 (5th Cir. 1977).

Accordingly, Mr. Harvey’s claims survive the motion to dismiss for failure to

exhaust. Given the allegations set forth in the Complaint and the fact that the absence of a

complete transcript renders the allegations uncontested, the Court finds that Mr. Harvey has pled

a colorable constitutional claim. The Commissioner’s motion to dismiss will be denied.

The Commissioner’s final argument is that this Court should reject the R&R’s

conclusion that Mr. Harvey needs additional time for discovery prior to summary judgment. The

Commissioner argues that under the Social Security Act “courts may not look beyond the

pleadings and transcript of the record to render their judgments” and notes that some courts

“have held that they lack authority under Section 205(g) of the Act to allow discovery or make

their own findings of fact.” Def. Obj. at 6 (citing Grant v. Shalala, 989 F.2d 1332, 1334, n.17

22
(3rd Cir. 1993); Mayes v. Massanari, 276 F.3d 453, 462 (9th Cir. 2001)). But this argument is

misplaced. While the Court may be limited to the record below in affirming, modifying, or

reversing a Commissioner’s decision on the denial of benefits, Mr. Harvey does not mount such

a challenge. Rather, he alleges a colorable constitutional claim that would excuse his failure to

exhaust and seeks a remand for a full hearing on the merits. In order to determine whether Mr.

Harvey’s due process rights were violated, the Court agrees with Magistrate Judge Robinson that

the parties must have an opportunity to submit further briefing and additional facts as needed. 15

IV. CONCLUSION

For the reasons set forth above, the Court will adopt the Report and

Recommendation in part. The Commissioner’s Motion to Dismiss will be denied and the

Courtroom Deputy shall set a status conference as soon as possible. A memorializing Order

accompanies this Opinion.

Date: July 1, 2015 /s/
ROSEMARY M. COLLYER
United States District Judge

15
The Commissioner cites Walters v. Leavitt, 376 F. Supp. 2d 746, 756 (E.D. Mich 2005) for the
proposition that discovery is not “permitted when the court’s subject matter jurisdiction is
challenged for a failure to exhaust administrative remedies, as is the case here.” Def. Obj. at 6.
But the Commissioner extends Walters beyond its facts. Walters determined “that discovery
related to Defendant’s facial and factual attacks on subject matter jurisdiction is not required”
because it “is undisputed that Plaintiffs have failed to exhaust any administrative remedies, and
Plaintiffs have not identified a disputed factual issue that would alter the court’s jurisdictional
conclusion under the statute.” Walters, 376 F. Supp. 2d at 756.

23