classrooms · faculty evaluation · guest post

Guest post: She’s Hot: Female Sessional Instructors, Gender Bias, and Student Evaluations

This post by Andrea Eidinger was originally published on ActiveHistory.ca and is reposted here with permission.
_________________________________________
I would like to acknowledge and thank the many female instructors who got in touch with me over the past week, not only for their bravery in sharing their experiences with me, but for their strength in continuing in their dedication to the field of history and education. I am profoundly grateful and honoured. 
“I think your feminist stances are slightly overcorrecting reality. I’m sure minorities had a harsher experience than women, ESPECIALLY today, a point you seem to overlook. You’re a really nice person though.”
That comment comes from my student evaluations from one of the first courses I ever taught, back when I was still a graduate student. At the time that I read that, I burst out laughing. I mean really, how else can you react to that kind of statement? But many courses and student evaluations later, I am starting to think that this is reflective of a larger problem in the world of academia, and history in particular, with respect to female sessional instructors and course evaluations.
Over the course of the past year or so, there have been a number of studies that have emerged detailing the gender bias against female instructors in student evaluations.  According to one study, male professors routinely ranked higher than female professors in many areas. [2] For instance, male professors received scores in the area of promptness (how quickly an assignment was returned) that were 16% higher than those of female instructors, even though the assignments were returned at the exact same time.  Another research project, which examined word usage in reviews of male and female professors on “Rate My Professor” found that male faculty members are more likely to be described as “funny,” “brilliant,” “genius,” and “arrogant,” while female faculty members are more likely to be described as “approachable,” “helpful,” “nice,” and “bossy.”[3]
While many of these studies discuss the negative impact that this bias has on tenure and promotion few consider how devastating they can be to sessional instructors, particularly given the overrepresentation of women at this academic rank. Although data on sessional instructors in Canada, both contract and regularized, remains scarce, what we do know based on a 2016 report on sessional faculty at publicly-funded universities in Ontario is that 60.2% of sessional instructors identity as female. Most of these individuals have Ph.Ds. and will spend roughly 4 to 5 years working as a sessional instructors with the hope of securing  full-time positions within academia. During these 4 to 5 years, 53.2% of these individuals will secure contracts that are less than 6 months in duration while the next largest group, at 18.2% will not have any current contract at all.? And declining enrolment in history courses across the country means that jobs of any type are becoming more and more scarce.
The effectiveness of sessional instructors is often evaluated based primarily on student evaluations, particularly when it comes to questions of hiring, contract renewal, regularization, and promotion to tenure-track positions. (This is in spite of solid evidence that student evaluations are not good measures of teaching effectiveness). Consequently, female sessionals often face a serious disadvantage compared to their male colleagues.
Here is a quick sampling of some of the more problematic comments I’ve received over the years:
  • “The focus on social history was good but I did not learn events leading to confederation. I didn’t come out of this course with any more information, except gender and race struggles, than I came in with.”
  • “Although Andrea stated on the first day she would teach a peoples[sic] perspective it was not illustrated how much was going to be focused on first nations and women’s history.”
  • “A bit biased in her views: very feminist and consequently an alternate view isn’t respected.”
While these remarks only represent a small percentage of the student comments that I’ve received on evaluations, they are extremely troubling. They also appear to be fairly representative of the types of comments that female instructors, particularly those who appear to be younger, receive on a regular basis. While writing this piece, I put out a call on social media for Canadian female instructors who teach history to get in touch with me if they were willing to share some of these comments on an anonymous basis. Eight women came forward and shared their stories. These comments and stories generally fell into five categories: bias, inexperience, unprofessionalism, behavior/appearance, and sexualization.
One of the most common critiques is that of “bias.” You can see several examples of these types of comments that I’ve received above. Many female instructors are heavily criticized for including women and gender history in their courses, and this is often described as them imposing a personal bias on history. They are often accused of “only having one point of view” and “shutting down opposing views.”
For instance, one instructor had a student that complained, “it was obvious that she didn’t quite enjoy the boys telling her that men are biologically superior. She rapidly dismissed their explanations as outdated and sexist without giving them the reason (although she did later on in the course elaborate). But it was clear that those students had lost interest since their ideas were being rejected.”
Related to this problem are comments about female professors being “inexperienced,” “new,” or “too young.”  Female instructors often have to face criticism from students who don’t feel that they are qualified to be professors. This is particularly a problem for female professors who appear to be younger than they really are or who happen to be short. Several of the instructors shared comments from students about them being “newer,” or just “getting started in teaching.” In one case, an instructor relayed that, “I also recently had an issue with a mature male student who made comments about me being “early in my career” and that he may be able to “help me” through his own line of work. He also expressed unsubstantiated doubts about my qualifications for teaching the subject matter after admitting to doing an online search of my background.”
On a related note, this can often result in direct challenges to female instructors in classes. Recently, a colleague related the following exchange on Twitter:

 

Another common complaint is that female instructors behave “unprofessionally.” The reasons for this can vary significantly, but often relate to references to one’s personal life. For instance, one instructor I spoke with had been forced to cancel a class because her child was sick. She joked about it in the following class. Then, on her student evaluations, she noted the following comment: “I found it very unprofessional that the Instructor referenced her child as an excuse for not being available or for missing class. This is not the concern of the student or any reputable faculty. Those issues should remain private and availability should be clearly indicated without reference to the Instructors personal life.”

Female instructors are criticized on everything from their behaviour to their appearance. Many are told that they should “smile more” or be “more approachable and friendly.” One student wrote, “she sounds like a dictionary with all the words she uses.” In some cases, students comment on their clothing choices in student evaluations, with comments like, “I like how your jewellery[sic] matches your clothing” and “I would love to know where you shop. You have some great dresses.”
More pernicious are the sexualized comments that female instructors received. These ranged from comments that “she’s hot” and “the prof is not hard on the eyes” to “I would really like to get you into a room alone and have some fun.” Finally, one instructor was told “I like how your nipples show through your bra. Thanks.” As the instructor herself noted, “this one led me to never wear those bras again. I now wear lightly padded bras exclusively. I was horrified when I got this one. Horrified. And not because my nipples were showing. Who the eff cares? But because someone was looking at me that way and sexualizing me while I was teaching a class in political history.”
Instructors have handled such comments in different ways, but nearly all of the instructors that I spoke with have stopped reading comments on student evaluations entirely. This is particularly the case in more recent years, as student comments have become increasingly aggressive and at times violent. Not only are these comments not helpful in any regard, but also they are profoundly unfair.
The end result to these kinds of comments is a situation that puts female sessional instructors in an un-winnable position. Their job performance is judged on teaching evaluations that are significantly biased against them. And yet teaching evaluations are used to make hiring decisions, where female instructors are ranked alongside with their male peers, on the assumption of an even playing field. And when there are no second chances and bad teaching evaluations can spell the end of your entire teaching career, female instructors get the short end of the stick.
Further, there are few support systems in place for female instructors to help them deal with these kinds of comments as well as misogyny in the classroom. While some departments and department members are sympathetic, others are less so, and some are openly hostile to even the suggestion. Female instructors are routinely told to just “ignore” these comments,[4] or are reluctant to even raise concerns for fears of being accused of “not being able to handle it” or of not being sufficiently “grateful for having a job.” Most of us end up feeling entirely alone. The situation is often worse for women of colour, Indigenous women, women with disabilities, and LGTBQ+ instructors.
However, it does seem that at least one Canadian university is starting to take this problem seriously. In May of 2014, the University of Waterloo initiated the Course Evaluation Project Team, to “assess the current practice of course evaluations and provide recommendations for improvement.” Their draft report was released to the university community in November 2016, recommending the adoption of a cascaded course evaluation model that would be consistent across all faculties. More than ninety associations and departments responded, and the final report is pending following a full review of this feedback. Three groups of faculty in particular submitted the most detailed responses, the Faculty Association of the University of Waterloo, the Status of Women and Equity Committee, and faculty members from the department of psychology.[5]
Each of these responses recommended that student evaluations should no longer be used to evaluate faculty members due to the significant gender, race, and other biases. They all specifically refuted the idea that careful design can be taken to counter the gender and racial biases in student evaluations. Instead, these reports advised that written comments in student evaluations should only be for the instructor’s use, and that alternative assessment tools be used instead, such as teaching practice inventory or correlating teaching with in one course with student grades in later courses. It remains to be seen what the final report will say.
While I can’t provide recommendations about what kind of system should replace student evaluations, what I can say is that based on the feedback that I’ve received and conversations I’ve had with other female instructors, gender bias in the classroom, and academia, is a serious problem that needs to be addressed openly, with honesty and compassion. Not only do these biases end careers, but they also deprive students of superb instructors.
Andrea Eidinger is a historian of gender and ethnicity in postwar Canada. She holds a doctorate from the University of Victoria, and has spent the last six years teaching as a sessional instructor in British Columbia. She is the creator and writer behind the Unwritten Histories blog, which is dedicated to revealing hidden histories and the unwritten rules of the historical profession.
[1] Special thanks to Joanna Pearce for her comments on the piece!
[3] Scott Jaschik, “Rate My Word Choice,” Inside Higher Ed (February 9, 2015). You can use the tool itself, which was developed by Ben Schmidt, here. For information on how he developed the tool, click here.
[4] Thank you Christo Aivalis for the suggestion of this example.  The comments section of this article (and many similar articles) highlights the prevalence of the ‘just ignore’ attitude.
[5] To see the background research for the study as well as some of the other responses and commentaries, including those from students, click here. Interestingly, of the responses posted that website, only the Federation of Students was fully supportive of the draft report’s recommendations.
faculty evaluation · grad school · job market · PhD · slow academy · teaching

Rate My Gender: On Student Course Evaluations

Wanna know one of the things that worries me right now, as I draw ever closer to the end of my PhD? This.

You probably saw the article circulating a couple months ago, oh feminists. Slate recaps a recent study of an online course in a large public university in North Carolina that found that women are evaluated more harshly than men in student evaluations. 43 students were divided into four online discussion groups led by two professors, a male and a female–but the woman led one of her two groups to believe she was male, and the man led one of his two groups to believe he was female. The students never saw the face of their instructors, so had no reason not to believe them, and the instructors endeavoured to keep all variables as consistent as possible, submitting feedback concurrently and providing similar biographical information.

And guess whose ratings, ultimately, were the highest? Why, the perceived male, of course, irrespective of the instructor’s actual gender. Even in such non-personality-related issues as promptness of feedback. Their official report, “What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching” (Innovative Higher Education (Dec. 2014)), details how, for example, the perceived male received 4.35 out of 5 for promptness, but “when the same two instructors posted grades at the same time as a female, it was considered to be a 3.55 out of 5 level of promptness. In each case the same instructor, grading under two different identities, was given lower ratings half the time with the only difference being the perceived gender of the instructor” (10). Same went for the category of fairness, even though both instructors used the same grading rubrics and there was no major difference in grades across the groups. Overall “[t]hese findings support the argument that male instructors are often afforded an automatic credibility in terms of their professionalism, expertise, and effectiveness as instructors” (10).

Sigh. Okay. Cool. Other (older) research has shown that women sometimes receive higher ratings than men when they fulfill feminine stereotypes of being nurturing, accessible, available, warm,, welcoming, personable; while, at the same time, exhibiting ‘masculine’ characteristics, like being distant, unavailable, and authoritative, can cause ratings to drop (and students are more forgiving if the same characteristics are displayed by men. Y’know, because men are more serious and shit). And if you’re still not convinced, see also this study, which shows that female instructors face bias in larger courses, exacerbating the gender gap in academia as larger lectures send to result in more opportunities for promotion, hiring, and awards (I have no doubt that some of my fellow bloggers and readers have some stories in this regard). 

Of course, I have personal reasons for feeling embittered by this problem in this moment. You ready? Fall 2014 semester course evals!! (insert string of confetti and horn emojis) Yeah, those happened in the last couple weeks. Okay…can I just say that for my age and level of experience, I am a good professor? I know I am. I am very, perhaps overly, devoted. It is possible that my exceeding availability to students in terms of office hours, email response, and individual attention fulfills the feminine nurturing stereotype, but I also know that this approach suits my personality: I love people, I love getting to know people, I love interacting with students and feeling I can build into their lives on a personal level (and I also have the luxury of personal interaction due to small class sizes). But I am also very awaaaaare that I am a thin, young well-dressed, myhusbandthinksImpretty female from Canada who gives off a “cool” and nice vibe, so I tend to combat the possible perception that I’m a softy by maintaining strict standards of grading, especially at the beginning of the semester, when I want to push students to take my class seriously and strive for improvement. Consequently, I receive some backlash, both immediate and longer term. As an example of immediate backlash, I present to you this bogus Rate My Professor rating, mostly because it is JUST. SO. FUNNY. (posted mid-sem; and yeah, I’m pretty sure I know who this was):

 Although I am ultimately perfectly happy to distribute As where As are deserved (and so grade for improvement throughout the course), and although I ran two great Composition I classes last semester, with bright and engaged students who demonstrated measurable improvement in their writing and with whom I had some fun, important, memorable, rigorous discussions about relevant topics like racism and feminism and social media and the TV series Scandalthe official evaluations are not that great. I mean, they’re fine. But 50% of the students did not respond (aaaarrrghhhh), which of course, based on the Golden Rule of Yelp, means that the more disgruntled ones were more likely to respond in the first place, let alone provide detailed feedback. My courses were not perfect, obviously, and my pedagogical strategies have ample room for growth as I progress as a professor (fingers crossed), but there is a world of a disconnect between these mechanical numbers and scant comments, and the actual lived experience of being in the classroom.

Admittedly, a large factor at play may just be the response rate, as I received quite a bit of positive informal feedback (a number of students asked if I was teaching Comp II this semester so they could take me again, and I received a healthy smattering of lovely thank-you emails post-course, bless them). If I’ve learned one thing from this experience, it’s that at the end of this semester, as I teach my first lit course, I am hella gonna sit those students in the classroom and make them fill out the evals in front of me, because it is clear they do not quite understand their import and can’t be trusted to fill them out on their own.

But I have some reason to believe that some of my struggles with authority and with managing this masculinized “touch tough grader” perception relate to a gender bias in the academy. And hey, I’m going on the job market next year, so this isn’t just about hurt feelings.

____

Do you have any stories about gendered student feedback that you’d be comfortable sharing in the comments? Or, what can be done about all this? Is there some way we can share such findings with our students without coming across as pandering? Or are the structural problems just rooted too deep?

change · equity · faculty evaluation · kid stuff

Income inequalities


Back at the beginning of February, my least favourite newspaper reported on UBC’s decision to give all tenure-track, female faculty members a 2 per cent raise. Part of the rationale in extending the raise to all women, and not only those identified as underpaid, was to streamline what would have been an otherwise time-consuming process of identifying individual cases of income inequity. It also, intentionally, makes a strong statement about persistent gender income inequity in academia. By applying the increase across the board, UBC effectively said that this is an issue about gender and about women, rather than reducing it to individual circumstance. 


This is an important statement to make given that the article appeared just days before a report published by the Conference Board of Canada, looking at “How Canada Performs: Society.” While Canada achieved a B grade overall, one of the key areas with only a C grade was the gender income gap. Here Canada ranked 11th out of 17 “peer countries,” and, although the gender income gap has narrowed in recent years, the C grade has remained steady since the 1980s. 

What was most striking to my eye in the Conference Board report was the chart near the bottom of the page detailing relative earnings of women and men by occupation. The data for this chart comes from 2010 and the discussion notes, “Unfortunately, the 2011 census did not gather data on income differences by gender and education.” I assume that this was a casualty of the Harper government’s decision to do away with the long-form census in 2011 but I don’t know this for certain (and I would welcome being corrected or confirmed in the comments). Such a move would be entirely consistent with the Harper government’s track record on gender and equality. Unfortunately, it’s impossible to separate out academic from other occupations, given the manner in which the information is presented. Nevertheless, I assume that professors come under the category of that includes education, placing us in a category that earns, on average, 70% of our male counterparts (again, please correct me if I’m wrong). 

Certainly, there is only so much that one can do with the data as presented here. For instance, I’m not going to assume that I’m only earning 70% of what the men in my department, at my rank, earn. That said this report does demonstrate that for as much as I would like to think that I am being paid equitably relative to my male counterparts, I might not be. More importantly, other women certainly are not. So where do the persistent gender-based income inequities come from? 

In my recent experience, it is abundantly clear to me the role that childbirth and parental leave (as they are termed here) directly affect women’s income at the U of A. I would very much welcome other examples because it doesn’t help to simply equate women’s experiences in academia with the choice of having children (women do not equal mothers). Obviously, gender inequity is not simply about this subcategory of women. 

Nevertheless, how does childbirth and parental leave translate into gender-based income inequality at the UofA? If you are a tenure-track faculty member, each year you have to submit a report detailing your research, teaching, and service work from July 1 to June 30. This annual report is then used as the basis to determine how much of a merit increase you will receive, over and above any across the board increases negotiated by our faculty association. I’m going to spare you the incredibly boring details of our increment process, suffice it to say that it’s a 3 point scale (but as far as I know, no one ever gets a 3), if you get 0s or a string of 0.5s, you’re in trouble, especially pre-tenure. So you aim for 1s or higher. 

Merit increments that you get early on in your career have the longest potential impact, therefore for women who go on childbirth leave (most of whom do so earlier in their career) if their merit increment in that year suffers, their salary over their career suffers with it. And it makes a difference when you are a woman giving birth. The period for which your pay is topped up is 15 weeks for childbirth leave, 10 weeks for parental leave. Each parent is eligible for parental leave and each parent is also eligible for additional unpaid leave (up to one year total) although in this time you only get EI, which if you have a mortgage or another child in daycare, is a recipe for financial disaster. But what all this means is that women giving birth to children, unsurprisingly, go on more leave than their partners and as a result are more likely to not teach in any given year, have limited service commitments (because much service work in a department or university is a year or longer commitment), or have less research output. Meaning they have less to report on come year-end. 

One response to this, still frequently articulated (as was seen in responses to the recent federal court decision regarding childcare) is that women and men who have children are making a choice, and if this choice means that they are not producing as much, then that is the penalty they pay for the choice that they have made. But this response fails to take into account that these people are still working, just as hard as their colleagues, for the portion of the year when they are not on leave. Yet, it becomes more difficult to quantify this work in the absence of clear service and teaching commitments. People bearing children should not be penalized for the fact that service and teaching commitments operate on a schedule that is rarely accommodating to the uncertainties of pregnancy and childbirth (e.g. premature babies, medical emergencies). I was permanently removed (without consultation) from a service position when I went on leave after the birth of my son, rather than simply having a colleague stand in for me to deal with the handful of responsibilities that had to be completed in the months I was on leave. I have colleagues who have been awarded 0 or 0.5 for work completed in a year when they were on maternity or parental leave, due in part to limited teaching or service work in the reporting years. 

There are ways in which our evaluation process attempts to accommodate this issue. If you are on leave for less than 6 months of the year, your performance for the year as a whole is extrapolated based on what you did in the time you were working. It’s crude math, but if you got x amount of work done in 6 months, that work is multiplied by 2 to provide a basis for evaluation for the year as a whole. This means of accommodating the issues created by leave does work for some women. 

But – and here’s one rub – if you’re on leave for more than 6 months in any given reporting year, there is no formula for extrapolation. In this case, you’re conceivably better off slacking off at work for the time that you are back, because there’s little to no assurance that you will be appropriately rewarded for what effort you do put in. Ultimately though, each year when you are awarded a 0 or a 0.5 translates into thousands of dollars less income then if you were awarded a 1, in the course of a 30-year career. 

And here’s the other rub: this problem has been recognized at the UofA for quite some time and a solution has even been proposed and apparently been approved by various levels of governance at the university (although not those that ultimately matter). That solution, from what I understand, is to give anyone on childbirth leave an automatic 1. Certainly, it would not solve the problem of gender-based income inequality in academia, as bearing children is not the only factor at work. But it is one factor at work. And an automatic 1 in our reporting system to recognize the inequities produced by childbirth leave is no more blunt an instrument than a 2% raise for all female faculty members.
faculty evaluation · global academy · reform · research · risky writing · turgid institution

Scholarly Publishing is Broken

Scholarly publishing is broken–at least journal publishing, and at least in my experience–and I don’t want to be complicit in this brokenness anymore, just because it serves some of my purposes, some of the time.

Most loftily, we scholars imagine that we are creating new knowledge, and that new knowledge is a good thing, that it can move our collective human project forward, in some small way. It gets moved only once this new knowledge is publicized. Hence, scholarly publishing.

Much less loftily, scholarship is a kind of labour that we exchange for tokens of esteem, power, and reputation, the currency of the academy. The recognized coin of this realm is peer-reviewed, published pages. Hence, scholarly publishing.

I know that I want to create new knowledge, and change the world! And if I can get a full professorship into the bargain, as well as win the disciplinary and institutional pissing contests by which goods are allotted within the Ivory Tower, well, all the better.

These goals can conflict.

And so it is that I find myself in the weird position of having an article scheduled to appear in Women Communication Scholarship (pseudonym) and am ambivalent, even angry, about it. My little story indicates at least one small way that scholarly publication is broken, and how some of it is our own damn fault. Is my fault.

What’s making me angry is that I submitted to this journal because of its high reputation, its high rejection rate, its mass adoption by academic libraries … and it turns out that they have a standing two year delay on publication. Let me be perfectly clear: once you go through the whole year of being reviewed and re-reviewed and your piece is accepted, your publication date will be TWO FURTHER YEARS IN THE FUTURE. I expressed some shock to the editor when she sent me my August 2014 publication date, in April 2012. She is shocked, too, having witnessed the creeping commercialization of this work over a generation of editorship. But this delay is their new standard. They have a perpetual backlog of submissions and accepted papers, because of their impact, and because they are published by a commercial publisher, who will not let them clear this out with some double print issues, they will have a TWO YEAR DELAY FOR THE REST OF THE WORLD.

Now, I work in new media. My article will be about three years old when it finally appears. Older, actually, because it’s based on a survey that took some time to complete. It will be historical by the time it appears. It’s going to be out of the page proofs stage by Labour day of this year, then SIT IN A DIGITAL DRAWER FOR TWO MORE YEARS before it gets printed. As the bemused editor wrote to me, the brave new world of academic editing of commercially-published journals “both requires that we publish scholarship and that we don’t publish scholarship.”

This seems really, really wrong.

I consulted Twitter. My friends and colleagues in digital humanities were appalled. Some suggested pulling the article and submitting it somewhere with a faster turnaround. Some suggested back-door self-publishing–that is, use the citation information from the “forthcoming” journal and put the paper online somewhere so people could read it before it becomes irrelevant. I like this idea of guerrilla self-publishing.

I consulted my chair, who consulted my dean. They, by contrast, congratulated me on having my work “appear” in such a high profile venue, and told me to leave it there. I should not retract the article to publish it elsewhere with a lower impact factor, just to get it into readers’ hands. I could put it on my CV, they said, and it would “count” this year. So I will get a raise for heaving my work into a deep well. I must confess I like this idea, too, of appearing successful and important among my peers, and getting a raise, to boot.

To summarize: I get lots of chest-beating institutional credit for this “publication.” But no one actually gets to read my scholarship. It all leaves a very bad taste in my mouth.

This current publishing system is broken. It pits our desires for reputation and stature against a true public good, and removes the whole thing from academic hands to place it into commercial ones who have been quite canny at exploiting our desires for status and our lack of desire for detail work in marketing, bean counting, and publication.

As for me, I’m leaving the article where it is: this is the third journal I’ve submitted it to (it’s interdisciplinary and I have had the misfortune of getting one glowing and one damning review every where else it’s travelled) and I really want this work stamped with approval and circulating, however distant the future in which that happens. As a compromise between my ambitions and my scruples, I asked the editor if I could put a “pre-print” online, and she said it’s technically not allowed but that she understands, informally, that many other people do it. Nudge-nudge, wink-wink.

I ask you: if an article falls into the Taylor and Francis journal system and no one gets to read it, is any new knowledge created? If we’re all circulating these papers “pre-print” why are we bothering with these commercial publications at all, except for personal professional gain? And what should we do?

academy · appreciation · change · community · faculty evaluation · feminist win · job market · thank you · you're awesome

To all the men

Right now, I’m on my sixth conference / presentation / workshop trip of the last nine weeks. Let me just say that if I never get on an airplane again for another year (barring the flight home from here of course) it will still be too soon.

Still, traveling and conferencing and workshopping is great, and one of the reasons  is the opportunity to catch up with old friends, with mentors, with former students, and to make new contacts. This latest round of travel for me has felt really strange and wonderful because, for me, it feels a little like a victory lap: I got on my first plane right around the time my tenure was confirmed, and as I had tweeted and facebooked and emailed my friends about it, word spread. Every where I went, people congratulated me, sincerely and joyfully. People I knew well, and people I hardly knew at all. That really made it real for me, and even when Air Canada lost my Congress-bound luggage and I had to present in yesterday’s traveling clothes (hilariously, on a social media panel, wearing a t-shirt that reads “I have tenure and I blog”), I still felt supported and comfortable. Well, as comfortable you can be in a yoga bra in public, without a belt to hold your pants up. (I don’t like to set off the metal detector at the airport …)

What were we talking about? Oh, right. Men and why I’m thanking them particularly, today.

What has really struck me, this spring, is how much of my career and its success I owe to, well, men. Men who have supported me, even when I told them our field was dominated by middle-aged white guys. Men who held a plum gig for me even when I bowed up one year, to give birth, and plenty of others would have been happy to take my spot, and keep it. Men who wrote letters explaining what I contributed to a collaboration. Men who happily agreed to explain how work in my field doesn’t look like regular English professing, and what it’s worth. Men–high-profile, senior, busy men–wrote obviously very supportive reviews of my tenure file.

I knew that the colleagues I had solicited to write support letters for me were awesome. But as I travelled around this spring, tenure assessors came out of the woodwork, eager to know what had happened and very eager to wish me well. Other interested parties made a point of welcoming me to the next stage of my career, expressing genuine support for my work.

We talk a lot here about women moving up the ranks and taking positions of power and influence as chairs or deans or full professors or even vocal members of hiring committees. But for a moment I want to recognize the men who’ve made my climb a little smoother, my ascent a little higher than it might otherwise have been. Starting even with the man who emailed me to solicit my application for the job at which I’ve just been tenured.

Thanks, guys. I’m impressed by your caring, and by your outreach, and humbled by your support. Now, let’s tenure and promote some more women so they can share some of this avuncular glory 😉

conferences · faculty evaluation · going public · outreach · writing

Guest Post: Recycling is not a bad thing

Our first guest post of the ‘summer’! Jo Van Every had the classic experience of writing a humongous comment on a post here, and then watching it get eaten by Blogger. Luckily for us, she channeled her disappearing-comment energies into writing a full-fledged post, and it’s very topical: as conference season launches, it’s a good time to think about the “communication of scholarly results,” as our funders express it.

Enjoy!

——

This post was inspired by Aimée’s post Reduce, Reuse, Recycle. I have used examples from her post for the sake of convenience. Feel free to substitute names of journals and conferences in your field as you read.

I’ve written on my own blog about the tensions between publishing for validation and publishing for communication. While you will be judged (and validated as a scholar) based on your publications, the primary reason for publishing and presenting your work at conferences, public lectures, or wherever, should be to communicate.

If you have a communication orientation to your work, the recycling issue appears in a very different light.

Audience makes a difference

The list of occasions on which Aimée had presented similar work looked to me like it spanned a range of different audiences:

I’ve been joking that what I’ve been creating this week, in preparation, is a “Frankenpaper”: parts of Saturday’s 15 minute conference paper is built from text I created for a public talk in the Digital Media Series at Stratford, reworked for a lecture celebrating 50 years of the Faculty of Arts at UW, and then reframed in a minor way for an invited lecture hosted by the MA in Humanities at Laurentian University in Sudbury. Incidentally, those talks all revisited ideas and prose I first considered and wrote in 2005, for the Reader’s Forum of English Studies in Canada. Still with me? Okay. My conference paper is also built from an article I’ve recently submitted to Biography–which was written from the ideas I pulled together for a different conference paper for last summer’s International Auto/Biography Association conference in Sussex. Oops, I did pull stuff right from the conference paper, too, that I had removed from the article version of that research. The Keynote slides draw from the Stratford/Arts/Sudbury presentation, as well as from the IABA presentation.

The audiences for those various public talks are unlikely to overlap. Local events, like celebrations of 50 years of the Faculty of Arts, draw a local crowd. Public talks have a different audience from academic conferences. And different academic conferences have different groups of people. The Auto/Biography crowd are not the same as the English Studies crowd. (I know, for example, that there are sociologists in the former.)

The same can be said for different print (or online) publications. The people who read Biography are not the same as the people who read English Studies in Canada. And they certainly aren’t the same people who read journals in communication studies, digital media, or whatever.

The fact that you’ve heard it before doesn’t mean everyone in your audience has heard it before.

Audience also affects the content

In addition, each of those presentations/publications will not be exactly the same.

All research communication contributes to ongoing conversations. Those may be formal theoretical conversations happening in peer reviewed academic journals. Or they may be public debates taking place in the mainstream media and people’s living rooms. The general public are interested in your research in a different way than the students in an MA in Humanities, or your disciplinary colleagues at an academic conference. And you want to communicate something different to those different audiences, too. You will be engaging with them in different ways.

You will also contextualize your findings (empirical, conceptual, theoretical) in ways that are relevant to a particular audience. A paper for the International Auto/Biography Association will be different from a paper for English Studies in Canada because you have to make different assumptions about the audience’s familiarity with particular debates that you engage with, at the very least. A public presentation on Digital Media is more likely to be contextualized in public debates happening in mainstream media than theoretical debates happening in academic journals.

Chances are that you are publishing/presenting to those different audiences because you have contributions to make to different debates and those debates are happening in different places. Although the content overlaps, you have something slightly different to say about your research to those different audiences.

Again, just because you’ve said this before doesn’t mean you have. Or that you’ve said it in a way that this audience can engage with.

People need to hear what you have to say

Presenting/publishing in multiple venues is not “recycling” so much as giving people multiple opportunities to come across your work. If you only produce one publication/presentation from a given research project, you rely on the people that need to know what you’ve discovered/created finding that one place where you’ve told anyone about it.

It’s like the proverbial light under the bushel. It’s there. And if you know it’s there and lift up the bushel basket, you can see the light. But most people aren’t going to notice. If you have something worth saying, it’s worth saying in venues (live, online, in print) where the people who need to hear it can find it easily. You don’t need big gaudy neon signs but you need to be visible.

In doing this remember that any oral presentation is reaching a much smaller potential audience than a written publication. People are there to hear it or not. Whereas a print (including online) publication can be engaged with at another time, even years later. One reason to turn your academic conference papers into academic journal articles is to make them accessible to people that weren’t there, including people that won’t even be interested in your topic until 2 years from now. And if you want to reach people who don’t read academic journals, you need to also publish your work in venues they frequent — blogs, magazines, public talks, etc.

That ability to access the paper asynchronously (to use the fancy online learning jargon) also means that readers/listeners can refer others to your work. Maybe Jane heard your paper at that conference and thought it was really interesting. She knows people who could really use that knowledge. Is there a way for her to tell people about it and get them access to what you presented/published?

Validation is still important

The processes that validate your work as an academic only recognize some of those publications: the ones that communicate to audiences they value. If you want recognition and validation by peers in your discipline then presenting at conferences in your discipline and publishing in peer reviewed journals in your discipline is important. The fact that you also communicate to peers in cognate disciplines or interdisciplinary fields is likely to enhance your reputation in your field. Those publications will probably not substitute for publications in your discipline.

Communicating to non-academic audiences may also be valued in this additional way, though peers are likely to wonder what the time you spend on that is taking away from things they value more.

The question is, why are you writing/presenting? Who do you want to reach? What do you value? Organize your publication/presentation strategy accordingly.

In the end, you are probably more at risk of publishing too little than publishing too much. Stop worrying about recycling.

academy · change · faculty evaluation · ideas for change · promotion · reform

Mostly, I just like saying the word ‘dumbass’

“I really thought your talk was excellent,” she told me. “I think people really connected with what you were saying.” She paused. Then, “I have never heard a professor say ‘dumbass’ in a lecture before.” Apparently, lighthearted swearing, employed judiciously, appeals to general audiences, and diminishes the perceived unapproachability of the Sage on the Stage. Or at the coffee bar’s jerry-rigged lectern. Or at the public library’s classroom podium.
I give a lot of public talks. I love to do them, at staff brownbags, in the library, in bookstores with espresso machines, in classrooms opened up in the evening to the general public, to auditoriums full of high school seniors and their parents. Because I keep getting asked to do more and more of these, and because everyone is always so enthusiastic in talking to me afterwards, I flatter myself that I’m pretty good at this sort of thing–I like to think I’m getting more exposure for my research findings, doing public service with my how-tos, drawing students into the major, creating goodwill for the department and university, and drawing good press for everyone.
Does it matter?
Heather wrote this week about a new kind of Full Professor, someone who gains promotion on the basis of teaching excellence. We are learning, I hope her post indicates, how to broaden our understanding of what a valuable, effective, and dare I say, excellent professor looks like. Fantastic! I am really cheered by this development, in part because, as studies show, women so very disproportionately aggregate in the teaching-heavy parts of the profession, and to have a research university promote on the basis of what has become feminised labour? Is pretty damn cool.
Can I push that door open a little wider? I’d like us to think more about what outreach means. I’d like to revisit that buzzphrase a few years back (um, 13 years) to “go public or perish“: we were supposed to focus more on that, SSHRC prez Marc Renaud indicated, instead of the usual academic target to “publish or perish”?
I take going public pretty seriously. But I don’t take it anywhere near as seriously as publishing: I calculated as a junior professor that my odds of perishing were still very much higher for failing to publish than for failing to go public. I never, not once, woke up in a cold midnight sweat counting out on my fingertips my number of Lunch and Learn talks delivered, desperate to know if it was enough to make the cut. So maybe, actually, I don’t take it seriously. Maybe no one takes it seriously in the humanities, where we’re not usually developing global smoking cessation strategies from empirical research, or, you know, curing cancer and such. 
Anyhow, I’ve been parking all my outreach activities in the service section of my annual reports: you know, the part that’s worth the least, that puny “20” dwarfed by the “40/40” of teaching and research. But is outreach not, in many ways, teaching, research, and service all at once? Especially if it draws explicitly on your research expertise? 
[Note! Let me be clear! I’m not griping about my annual reports or my raises or anything particular to my own situation. Everything is pretty awesome, frankly, and I by no means wish you to think otherwise. But. I’m trying to think more abstractly.]
So I ask you: Does outreach–going public–really matter? Do you think outreach is ‘real’ academic work? Do you do it? Do you want to? And does being really good or really poor at it matter? How does going public promote excellence, or detract from it? 
academic reorganization · change · classrooms · faculty evaluation · reflection

What is being (E)valuated?

O, the teaching evaluation.

Often eviscerating, periodically baffling, and sometimes edifying. (OK, always edifying if one can take a step back and read them using some of Tenured Radical’s tips) What do teaching evaluations tell us about the institution in which we work? What do they tell us about our students? I daresay the teaching evaluation has something to tell us about the profession of professing that extends beyond a single course (this is something Heather brought up from a different angle some months ago)

Evaluations are on my mind for two pressing reasons: first, it is January, and we’ve just received the evaluations of fall 2010 courses. Second, because I am on the job market and without a dossier service to do it for me, I go through evaluations to select examples for my teaching portfolio. I find myself wondering what the evaluations say about the state of the institution as a whole. Of course, as the representative for the institution, I also find myself trying to interpret what the students are evaluating when they evaluate me.

Sure, my teaching evaluations are, on the whole, pretty good. What I mean by ‘good’ is this:

-When asked to comment on the “course content and organization,” students generally speak to the texts (whether they liked or disliked them, whether they felt the texts were useful for the course itself). Mostly, they say ‘yes,’ and generally when there are concerns with the texts the students speak to why they didn’t feel the texts were useful.

-When asked to comment on the instructor’s success in making the course interesting and intellectually stimulating, they generally speak to just that: my carriage in the classroom, or my ability–or disability–to demonstrate, generate, and sustain intellectually rigorous conversation.

Which is to say that for the most part students respond to the material as well as my efficacy as an instructor. And that’s useful for me on a number of levels.

However, things get a little more complicated when asked to comment on any of the instructor’s “special qualities” as a teacher (including “specific complaints” and “constructive suggestions”). Here students tend to address my personality and, sometimes, my mode of dress. I suspect that in part the variety of responses may have to do with the way that the question is posed (what makes a quality “special,” for example? Is this an earnest or a sarcastic question?) They have commented on my intelligence (or lack there of, in a few stinging cases), my approachability, my inapproachability, my overuse of theoretical language, my over-simplified language, and my shoes. These aren’t terrible responses; they are–or can be–edifying, and I’m slowly trying to learn to make use of them rather than take them to heart.

But here’s the open secret I find myself returning to each time I think about or read evaluations: some of us statistically rate lower on student evaluations. That would be women and minorities, not to mention women who are minorities of various kinds. shh! Which is to say that while it is sometimes impossible to prove for certain (and other times devastatingly easy to prove) that a given response is based on one’s gender or skin tone, or accent, or orientation the fact remains that it *might.* And that’s a problem, especially given that evaluations are used for job applications, as well as tenure and promotion. I believe–or want to believe–that members of/in the profession know how to read evaluations. But to what extent does this open secret reflect some deeper issues in the academy?

For me some of these deeper issues include a systematic failure to address inequity, systematic discrimination, and maybe, just maybe, a general failure to talk about these lived realities in a large-scale way that manages not to make them feel like they are someone else’s problem. Or worse, that these are “problems” that have been dealt with already.

And further, as Canadian universities continue the move to making student evaluations public (a move that I’m not certain I am against in principle, mind you) to what extent is the gendering and racing of evaluations made a significant part of the conversation? What would it look like to choose to make the communal aspects of the teaching evaluation–that we who teach all get them, that we are being evaluated on our own, but also as representatives (fairly or un-) of what the university looks like–public amongst our colleagues?

So what can I–an instructor who depends on “good” evaluations to get a contract renewal–do to address these fundamentally important issues? I don’t have the power to suggest a systematized teaching evaluation, and frankly the notion of such a thing smacks of over-systemization of public education. Here’s what I’ve been thinking about by way of making some change in the classroom:

-I’ve started introducing course by having the student spend 10 minutes early in the term writing about their values and concerns (I didn’t know about this study until recently, but it would seem I certainly haven’t invented this). The idea here is that they articulate their values to themselves and to me. I work to integrate their values, concerns, etc. into lectures about the material.

-I also have the students set three goals for themselves in the course. This seems to get them thinking about what they want to learn, and it also seems to underscore that this is a collaborative process. Sure, I’m the professor, but I use this exercise to stress that their intellectual participation is vital for a rich, engaged classroom.

-I often do mid-term evaluations of the class.

-I’ve started talking about my evaluations, for one thing. On a personal level, and as a relatively new member of the department, it helps to hear about other colleagues’s experiences. On an institutional level, discussing the form, function, and trends of the evaluation process as a department would get the larger, more trenchant issues into an open discourse.

What strategies do you employ when reading your own evaluations, the evaluations of applicants, or your colleagues? What are your thoughts on making evaluations public? (Don’t forget that they kind of already are) And what can we do about interrogating and interpreting the language of the evaluation when it asks, for example, about “special qualities?”

______________________________________

*For a very few of the many examples out there, you can see the CAUT policy on evaluations here (note the caution in part 1), you can see Vanderbilt’s large accumulation of data here, a related post about the gender and service here, and for personal perspectives you can read Alfred Young Man on being a Native teacher in Canada here, and a compelling anonymous guest post at University of Venus here

faculty evaluation

A Legacy that Counts

One of the delights of a career well spent, I’m learning, is a world full of former graduate students.

My partner and I spent a marvelous Monday evening with LGT, who finished her PhD here in 2001 (her defense was the week after September 11th) and landed a job at a small college in the deep south of the USA. It’s probably not the job she imagined – did I mention, the deep south? – but she has flourished. She is, I confirmed last night, a marvelous teacher. I saw her Teacher Look and I heard her Teacher Voice, both of which are awe-inspiring (and, therefore, awe-some, though usually to different audiences). She told stories about her colleagues and her classes, her triumphs and her questions. She has established an annual lecture series; she is working on her second book; she is tenured and promoted. We talked about her grad school experience ten years out. All evening I just kept thinking how proud I am of the person she’s become and what a gift it is to work with someone like her.

This morning, a current graduate student aced her candidacy exams. This afternoon, I started organizing the thesis defense for yet another brilliant student. And although we haven’t said this explicitly, Aimee, aka digiwonk, aka Friday’s blogger, completed her PhD under my supervision too.

It’s a world of amazing people that just keeps growing.

Next week at my school the Faculty Evaluation Committee will hole up for five continuous days to evaluate the successes and failures of the academic year. They will proceed with scrupulous procedural fairness; whether that’s what the academy needs – whether that’s what women in the academy need – remains, for me, an open question. Increments will be handed out and moved around and reconsidered. Nonetheless, at the end of the week many people will feel that their teaching is unrecognized, their research undervalued, their service made invisible. FEC can make you feel like crap, but even when it rewards you, it’s nothing like spending an evening with a fully fledged colleague and friend.

As I like to say, when all else fails it’s nice to have your integrity to fall back on.

equity · faculty evaluation · grad school · women

"Dear Committee …"

Dear [admissions / hiring / scholarship / fellowship / internship] committee. I am writing to you to support [student / colleague / supervisee / former student / prospective student]’s application …

How many of these letters have you had written on your behalf? How many have you written for others? How many have you read, as a member of the ‘dear committee’ in question? Letters of recommendation pervade academic culture, and the world outside it. So take a minute, and go and read this: “Reference Letters Cost Women Jobs” at Futurity.org. Go. Then come back. (Thank you to reader Heidi for bringing this to our attention, btw.)

Are you agog? I am.

Reference letters are hard. They’re hard to write and hard to read. They are consequential, and treated with some reverence and a lot of formality. A reference letter is held in strictest confidence, on the understanding that the letter writer is speaking some hard or secret truth to a committee of whatever sort, a truth whose utterance can only be assured by this guarantee of confidence. A graduate admissions committee is committing to support, say, an incoming PhD student for a minimum of four years: we want to know what we’re getting into! A hiring committee is looking to make a huge commitment to a potential colleague–we hope a reference letter will help us pick those three candidates out of the pool of 50 that we might best interview.

But reference letters are also often written in code. They are increasingly prey to the cult of the superlative, where all the adverbs (fantastically! superbly! tremendously! extremely! immensely!) we’ve worked so hard to prune from our other writings magically reappear, because we need to make the applicants we write for stand out. It seems like every applicant is always ranked in the “top 2%” of everyone the referee has ever had contact with. This paradox requires careful interpretation of the narrative portions of the letter.

There is also a kind of reference letter that seems to be written under duress: where the referee has tried gently or not-so-gently to dissuade an applicant, who nonetheless insists on getting said letter. These are easily enough deciphered by committees, but they never come right out and say, “I don’t want to write this letter, because I don’t think this student is ready for grad school.” Instead, they usually say something like “While I am happy to help out X with her application, I cannot be as thorough as I might be had I taught her in a course other than the 500 person introductory survey six years ago.”

In my time at Waterloo, I have written more than 40 different reference letters for students. I have served on the university committee that ranks SSHRC graduate fellowship applications. I spent three years on the graduate committee readings SSHRC and OGS apps, as well as applications to the program. I have spent three years on the appointments committee. I have read hundreds and hundreds of reference letters, all written in some form of code.

So this article has knocked my socks off. It’s not that I’m so terribly surprised that, generally, that gendered language is used to describe job candidates and students. It’s that the code words the article notes are ones I very much recognize as keywords I look for when evaluating letters. I do tend to be impressed by some of the descriptors coded female, and less impressed by some of those coded male. But over all, I hadn’t noticed these as gendered, and a lot of the ones from the feminized list of descriptors I have often understood to be code for “not that smart or accomplished.”

Let me tell you, I’ve been digging through all the reference letters on my computer that I’ve written for others. And I find myself largely innocent of gender-torpedoing those I’ve written for. But I’m sure as hell going to be a lot more conscious of this as I read all the letters I use to evaluate candidates, and more careful still of how I write them.