Tuesday, December 21, 2010

The cross-cultural effects of electronic mail exchange on the Turkish University students of English as a Foreign Language (EFL)

  • ISSN 1442-438X
  • CALL-EJ Online
  • Vol. 3, No. 1, June 2001

Introduction

This paper focuses on the role of electronic mail (email) exchanges in promoting intercultural learning. It is based on qualitative research from an email project between Turkish university students of English as a Foreign Language (EFL) and people of different national cultures around the world. The communicative approach (Hymes, 1974), or the intercultural communicative approach, preparing students for future needs (Belisle, 1996; Berenfeld, 1996), and reflexive impact (Byram & Fleming, 1998: 4, 12) are the leading principles underpinning this project. In practice, the emphasis is on fluency first, and grammatical accuracy second.
There can be little doubt today that email forms an integral part of our daily communication through the Internet. It was predicted that there would be over 150 million Internet users by the end of the year 2000, and that prediction has now been overtaken. The Internet has had a tremendous effect on the way in which we think, conduct business and teach. The British Council report on the Internet and English Language Teaching (1996) reports that schools worldwide have used email for international communication activities since the late eighties.
Many EFL students have corresponded with keypals (people exchanging emails) in English. This is a good opportunity to practice English and to learn to communicate. In addition, it is a highly motivating way for students to get valuable practice in both reading and writing. Not only can a keypal exchange improve specific skill areas, it can also have a profound impact on students' attitudes towards the target language and culture, and it can provide them with their first chance to really use the language outside the classroom context.
Language teaching should focus on both the learner's own culture and other cultures. This is a natural consequence of 'cultural awareness', a significant aspect of language learning. Without cultural awareness, a language cannot be properly understood.
We understand our own culture partly through understanding other cultures. Comparisons between the learner's own way of life and that of the other language community is an essential means to better understanding both. Comparison of our own and other cultures helps learners to perceive and cope with difference.
The development of communicative language teaching in the 1990s was characterized by an increasing emphasis on the integration of language and culture learning (Byram, 1997; Candlin, 1989; Kramsch, 1993). At the same time a close relationship was noted between the use of a task-based approach and the development of functional learning environments, and the potential of electronic learning networks for enhancing intercultural learning was recognized (Riel, 1994, pp. 457-458; Peterson, 1997, p. 31).
Candlin (1989, p. 3) affirms the importance of focusing on “the issue of the learner's personal identity versus his or her social identity and cultural identity within the process of language learning.” Kramsch (1993, p. 183) describes the following goals of foreign language learning and teaching:
  1. communicate appropriately with native speakers of the language;
  2. get to understand others;
  3. get to understand ourselves in the process.
The degree to which one is able to understand others and oneself, and to learn interculturally, depends on the learners' ability to open up to each other on an emotional plane, and the degree to which they are involved in meaningful activities that allow for negotiation of meaning. In the meaning-negotiation process, learners might strive for at least partial understanding of the communication partner, changing their own perspectives in the process to incorporate aspects of the other's point of view, or even changing their own perspective completely (Bredella, 1992). Central to this process, which is obviously dialogic, are tasks that initiate possible negotiations of meaning. While many proponents of task-based language learning note the importance of negotiation of meaning (see Crookes & Gass, 1993), Candlin is notable for the emphasis he places on empathy and tolerance as well as a critical stance in task design.
In addressing the educational goals of task design, Candlin (1987, p. 17) affirms that the exchange between self and other can be enhanced by tasks that allow “learners to become more aware of their own personalities and social roles, and those of their fellow learners...” While tasks highlight “how language is used to reflect and reinforce our value and belief system”, Candlin also sees the need “for tasks to take a critical stance” since the improvement of relations between learners' worlds inside and outside the classroom depends “upon mutual acceptance and tolerance of their members, and overcoming the barriers raised by ideology and prejudice.”

Method

Participants

The participants in this study consisted of five Turkish students. They enrolled in the elementary level classes of English at the University of Bahçesehir's School of Foreign Languages and Informatics during the academic year of 2000-2001. University of Bahcesehir is an English-medium university in Istanbul. Their placement in the elementary level is based on their scores on the placement test administered by the School of Foreign Languages and Informatics.
Participants were given alternative email addresses of possible keypals from various countries, from which they selected their partners depending on personal preference.

The way the email exchanges are arranged

The researcher provided the alternative keypals emails taken from various sites connecting ESL learners. The subjects choose among them on their own preferences. The provided sites are:
  1. Dave's ESL Caf? - http://www.eslcafe.com
  2. E-Pals - http://www.e-pals.com
  3. Linguistic Funland - http://www.linguistic-funland.com/addapal.html
  4. EF Englishtown - http://www.englishtown.com/
  5. http://www.merrywing.com/penpal.htm

Procedure

Duration

The project lasted four weeks, starting in the third week of November and ending in the third week of December 2000.

Training

The researcher trained the participants about sending, receiving, replying and forwarding emails.

Observation

The researcher observed the email exchanges. Participants sent the researcher a carbon copy of each email they sent, and forwarded each email they received from their keypals.

Monitoring

There was no interference from the researcher in the grammaticality, comprehensibility or content of the emails. However, the researcher gave some possible topics to mention upon the request of the participants.

Limitations

Because the participants were elementary students, they had problems of accuracy and syntax. Some of the people the participants tried to contact did not respond and some of their keypals gave only a few responses. An example of a lengthier exchange that is representative is given in Appendix A.

Task

Given alternative keypals from various countries, participants were required to choose one or more keypals and exchange emails with them for four weeks. They were going to send a copy of each message they sent to their keypals and forward the emails they received to the researcher. The general and specific objectives of the project follow in the next two sections.

General objectives

  • promoting cross-cultural and social contact between different and distant communities
  • promoting exchanges of experiences that can lead to a better knowledge and understanding of one another
  • opening up of new and different horizons, perspectives and visions
  • broadening of general knowledge; and contact with other people and/or peoples, and cultures
  • broadening linguistic competences/skills in the foreign language
  • integrating new technologies in the learning process

Specific objectives

  • stimulating the pleasure of reading and writing
  • stimulating the writing process in the L2
  • promoting research habits
  • bringing the school and community closer together
  • giving students a wider reading audience/public

Data analysis

Techniques

Content and communication were evaluated through observation and interview. Email copies sent by all sides were observed to identify the processes of mutual interaction, communication and socialization. Participants were interviewed about their progress and problems all through the email exchange process.

Analysis

The initial messages exchanged display a need for the participants to begin to get to know each other through the sharing of basic information such as who they are and where they come from. These identification indicators include name, age, school, where they live, looks or physical attributes, characteristics, favorite hobbies, families or friends etc. The names of the participants are the most frequent indicator in messages. This is followed by age, school, area in which they live, physical attributes, family, and other interests.
The nature of content of the messages ranged from general to specific or topical, depending on whether the message tended towards only establishing contact and building rapport such as 'What is your favourite sport?', 'What sort of food of you like?', 'What do you do in your spare time?', or specifically focusing on a topic or issue for discussion such as 'Could you please tell me about Istanbul?', 'Do you celebrate Christmas?'. Again, the topics for discussion were decided upon by the participants themselves as they responded to each other's interests.

Results

The study showed that an international email exchange between EFL students and people from different countries yielded a number of positive results. Students proved to be more motivated and displayed a positive attitude towards communicating to increase their cross-cultural awareness. Analysis of the electronic messages also showed maturity in students' cognitive development. The project also enhanced students' thinking skills as they responded to specific messages directed to them.
The interviews between the researcher and the participants showed that the participants:
  • liked and enjoyed having friends from abroad
  • had a feeling of curiosity in meeting new people and in learning about new cultures
  • liked to write in English
  • liked to improve their English
  • liked to learn about new cultures and personalities
  • exchanged cultural and personal topics
  • improved their vision/worldview

Pedagogical implications

Students must be encouraged to exchange emails to improve their cultural vision as well as to specifically learn English. Students become curious when they learn about other cultures, which encourages them to write and read more and improve their related skills and general English even if their level is beginner.
However, both researchers and participants need to understand the underlying overall purpose of the project and also how it will help them in specific areas. This will lead to a fuller appreciation and motivation on the part of individual schools to work towards meeting their specific targets set.
A clear step-by-step process of implementation as outlined in the specific stages below will determine clearly the procedure involved and what is required at each stage. This framework is a useful guide as to how much time and effort are required at each stage because the extent of involvement of teachers and the technical support staff will differ at each point of the project.

Advice/guidelines for further research

The following advice is based on personal experience and on feedback collected from different books and articles.
  • jot down all ideas that come to your mind about a possible project
  • start small and build on your experience
  • feel comfortable with the software and hardware you will be using
  • give 'meaning' to the project
  • structure its objectives, tasks and expected outcomes very clearly
  • define ages, grade levels, knowledge level (beginners, intermediate, advanced) and number of students involved
  • set beginning and finishing dates, as well as deadlines for certain tasks and/or phases; however, if necessary, allow for some flexibility
  • discuss the outline with your students (if there isn't enough time to plan the project with them)
  • post it in mailing lists and newsgroups
  • be quick to answer requests for explanations
  • try to find a partner you relate to
  • start by breaking the ice; let students introduce themselves and talk about their hobbies, interests, etc, in order to get to know each other and discover things in common
  • encourage genuine personal contributions from your students
  • be flexible about content: the 'unexpected' may be enriching
  • keep regular contact with all participants
  • keep a record of everything as you go along, including messages sent/received, your comments on how things develop, necessary changes/improvements, etc.
  • send 'thank you' messages to everyone at the end of the project

Further research

Cultural exchange via email exchange motivates students to improve their reading and writing. This effect could be researched. What elements in reading and writing are improved? To what extent?
The following questions also deserve to be researched:
  • What other methods and strategies can be used to direct students to exchange more and more efficiently?
  • Students don't know how to expand cultural topics and focus on interpersonal relations. Is that good?
  • How can we direct them for cultural exchange more?
  • What could be results of a global friendship?

Conclusion

There is no doubt that modern information technology provides students and their teachers exciting possibilities for innovative out-of-classroom opportunities in the teaching and learning of the English Language. In this study, for the teachers, it was experiencing a progression from an initial sharing among themselves of their personal selves and school culture, to one where their students appeared to take over the project in a direction of their own. The pupils' personal understanding of the world then extended to beyond the traditional confines of the classroom. The move away from set tasks associated with conventional classroom-based instruction encouraged a natural move towards and support of work which evolved directly from students' own interests, experiences and responses. This autonomy and self-directed management of their own learning process helped them bridge ties and cross national boundaries.

Ackowledgements

I would like to thank my students and their keypals for their effort. In particular, I would like to thank the students who gave permission to publish their email correspondence (see Appendix A).

References

  • Belisle, R. 1996. Email Activities in the ESL Writing Class. The Internet TESL Journal. 2(12). Available at http://www.aitech.ac.jp/~iteslj/Articles/Belisle-Email.html
  • Berenfeld, B. 1996. Linking Students to the Infosphere. T.H.E. Journal onLine [online] available at http://www.thejournal.com/journal/magazine/96/apr/feature3.html
  • Bredella, L. (1992). Towards A Pedagogy of Intercultural Understanding. Amerikastudien [American Studies], 37(4), 559-594.
  • BRITISH COUNCIL. 1996. The Internet and ELT: Other Internet Resources for ELT. Available online at: http://www.britcoun.org/english/internet/engother.htm
  • Byram, M. (1997). Teaching and Assessing Intercultural Communicative Competence. Clevedon, UK: Multilingual Matters.
  • Byram, M. and Felming, M. 1998. Language learning in intercultural perspective: Approaches through drama and ethnography. Cambridge University Press.
  • Candlin, C. N. (1987). Towards Task-Based Language Learning. In C. N. Candlin & D. Murphy, Language Learning Tasks (Pp. 5-22). Englewood Cliffs, NJ: Prentice-Hall International.
  • Candlin, C. N. (1989). Language, Culture and Curriculum. In C. N. Candlin, & T. F. Mcnamara (Eds.), Language, Learning And Community: Festschrift In Honour Of Terry R. Quinn (Pp. 1-24). Sydney: Macquarie University, 1-24.
  • Crookes, G., & Gass, S. M. (Eds.). (1993). Tasks in a Pedagogical Context. Integrating Theory and Practice. Clevedon, UK: Multilingual Matters.
  • Davis, R. S. (1995). Mextesol Journal Volume 19, Number 2
  • Hymes, D. 1974. Foundations in sociolinguistics. Philadelphia: University of Pennsylvania Press.
  • Kramsch, C. (1993). Context and Culture in Language Teaching. Oxford, UK: Oxford University Press.
  • Peterson, M. (1997). Language Teaching and Networking. System 25,(1), 29-37.
  • Riel, M. (1994). Educational Change in a Technology-Rich Environment. Journal Of Research On Computing In Education, 26(4), 452-474.

Appendix A

Samples of one pair student keypal emails (in dialogues)

Cihan's Dialogues:

  • From: cihan göncü <cihangoncu@yahoo.com>
  • To: <mitsukocci@mtb.biglobe.ne.jp>
  • Cc: <asakar@bahcesehir.edu.tr>
  • Sent: Saturday, November 25, 2000 5:37 PM
  • Subject: hi friend!!!
  • hi!!! I'm Cihan.I'm 18 years old, I live in Istanbul,Turkey.I'm a student in university. My favourite sport is basketball because I'm a basketball player in Yesilyurt Sport Club. I have been playing basketball since 1993.I like metal music but I listen to all music.And I want to mark a pen pal. Nice to meet you. please write me back soon. I'm waiting your answer. see you later!!!!!!!!!
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: =<cihangoncu@yahoo.com>
  • Subject: Thank you for your letter
  • Date: Tue, 28 Nov 2000 22:49:20 +0900
  • Thank you for writing me and I was so glad. Nice to see you! I have heard the name “Istanbul”. But I don't know about it very much. I wanna know where it is, how it is like... Please tell me about your country. I used to belong to basketball team till last year. Iwas playing for only 3 years. Since I enterd the college, I play tennis. It's so exciting!! By the way, are you boy or girl? sorry, but I can't distinguish only your name... Of course, I'm girl. I majar in English in univercity. Everyday, I enjoy my campus life!! Please tell me your campus life. I'm interested in R&B. Please write me soon.
  • From: cihan göncü <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • Cc: <asakar@bahcesehir.edu.tr>
  • Sent: Wednesday, November 29, 2000 7:48 PM
  • Subject: Re: Thank you for your letter
  • Thank you and I was so glad,too. Istanbul is very big city. It has got very mixed traffic,every day. Famous historic districs Topkap? Palace,Dolmabahce Palace,Yerebatan Palace and Ayasofia museum. They're very beautiful buildings. Istanbul has got two bridges. theri names are Bogazici Bridge and Fatih Sultan Mehmet Bridge. I know last name is very long but you can say it Fatih Bridge :-D. Istanbul is on the south west to Turkey. The best cities are Levent, Taksim, Bakirkoy, Aksaray and Besiktas. By the way, who is me? I'm a boy. My height is 1.96. I said “I'm tall”. It's true. please tell me your describes and your city life. I'm learning english. I'm in first level.So, My campus life is very easy.My friends are talking Turkish but I want to speak english.I think, I will be a big student in the university :-D. Our lifes are past the cafe. I don't smoke, I don't like smoke. But my friends are very smoke in cafe every day. I'm staying my home with my family. I will to mention to they next mail. see you later nice to meet you and see you!;-D.
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: How are you.
  • Date: Wed, 29 Nov 2000 23:27:36 +0900
  • Hi! now, Japan time is 11:04 p.m. I have just finished my English home work. I wonder how long the gap of time between Istanbul and Japan. Have you been to foreign countries? I've been to England for 6 weeks When I was 16. It took about 12 hours from Japan to England. I remember I was so tired but lookd foward to stay there. England was so beautiful. Only a point I couldn't like was their food!! It was not good... I wanna live there but I can't coz I hate their food. I think Japanese food is so delicious. How about your country food? I hate smoking,too. But I have friends smoking,too. The boys of my tennis club always smoke! So I got used to the surroundings. Uhooo, recently, it's cold in Japan. It's 12 degree. I hate winter. Do you klnow Japan has 4 season, Spring, Summer, Autumn, and Winter. Spring is warm. Summer is hot(about 30 degree). Autumn is a little cool. Winter is so cold! We usually wear coat in Winter. How is your country's weather? See you soon.
  • Sent by: cihan “göncü” <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • cc: CN=Asim SAKAR/O=Bahcesehir Universitesi@bahcesehir.edu.tr
  • Sent: Wednesday, November 29, 2000 5:37 PM
  • Subject: Re: thanks,and you
  • hi Mitsuko! thak you for your mail.Turkey time is 11 pm. I have just finished my homework,too. I don't know how long gap of time between Istanbul and japan. But, maybe it's 12 hours. I don't know because I don't foreign countries. But I want to see.Iwent to other cities. Because, you know I'm a basketball player. Our matchs are in their cities. There is a one saturday to Yesilyurt between Kusadas?. I saw other cities.their foods are very very unusual. Adana's Kebap,Urfa's cig kofte,Afyon's kaymak,... they are foods' turkish names. You are come here to next days.I will wait you. Istanbul's weather is very cold now. maybe it's 10 degree as if freezing cold,uuuuv!!! Istanbul has 4 season,too.Spring,Summer,Autumn and winter.Now autumn. but it as if winter. Spring is little cool,Summer is boiling hot(about 37 degree),Autumn is little cold,Winter is freezing cold(about -12 degree). We are always wear coat in winter. So, again, thank you for your mail. and you tell me your family and what do you look like. ;-D. ok! see you!!!!
  • From: cihan göncü <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • Cc: <asakar@bahcesehir.edu.tr>
  • Sent: Friday, December 01, 2000 5:11 AM
  • Subject: Re: How are you.
  • hi mitsuko! How are you? I will go to Kusadasi on tomorrow. then I will play basketball match. When I come back my home I read your mail and send mail to you. see you sunday my friend I want to see your mail on sunday...
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: Introduce myself
  • Date: Sat, 2 Dec 2000 16:22:46 +0900
  • Hi cihan!!! How are you today? I was absent from school yesterday becase of cold... I'm getting better now. How was your basketball match? Your position is center, isn't it? I used to play basketball as center, too till last year. It's so hard sports! By the way, do you want to know my appearance? I have got a black eyes, brown hair. I'm 164 cm tall. My friends tald me slim. My hair is straight, about sholder. That's all. There are 7 peaple in my family. My grand parents, my parents, 2 elder brother, and me. My grand father is 80 years old, my grand mother is 76, my father is 54, my mother is 50, my elderest brother is 21, my elder brother is 20, and I'm 19. All of us is so fine. My mother is a elementary school teacher. My father works at office in Tokyo. My elderest brother is a university student and major in Psychology in Kyoto. Kyoto is far from here, so he live alone there. My elder brother is a university student, too. He goes to Tokyo university, the highest level in Japan. I go to my university by train. Japanese usually use trains. But it takes about 1 and a half hours from here to the university. It's far. I always listen music with walkman. Do you have walkman that we can listen music by headphone. It's so useful. I got a car license this year. So I often drive a car. Have you ever study about Japan? I have studied about Istanbul in history class. I know Osman, Constantinople, and so on. Which language do you speak ? Of course, we speak Japanese. Please write soon. Bye.
  • Sent by: cihan “göncü” <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • cc: CN=Asim SAKAR/O=Bahcesehir Universitesi@bahcesehir.edu.tr
  • Sent: Sunday, December 3, 2000 5:37 PM
  • Subject: Re: the best team yesilyurt
  • hi mitsuko! Thanks and you? I was so sad for you but now I'm happy because you are getting better.The match was very well. Match's score finished YES?LYURT=142, Kusadas?=68.I enroled to 30 points. I use to play basketball as forward. I did five slam dunks on that match.Yes,maybe it's so hard but I think it's easily. you are tall according to japenese people.I think you are so beautiful. What did you do at the weekend. I went to Kusadas?. Kusadas? is so beautiful city. by the way, there are 4 of us in our family.my parents,my elder sister and me.My father's name is Cemil,40 years old.He is an apartment keeper.he is very friendly My mother's name is Zulbiye( I know her name is so hard),42 years old.she is a housewife.she is a kind.My elder sister's name is Aygul,23 years old. she is a babyattendant.And there was one elder brother to me two years ago.but he died in 1999 in war. He was a soldier on north east Turkey.I so wish him.
  • By the way I goes to university by bus.it's so far.because it takes 1 hours from here to de university.I usually listen to music with walkman but I always listen to music on my computer. I didn't study history from japan. But I know Hiroshima and American people's throw to Atom bomb.(I don't know atom bomb from english.)When I heard and I so sad. We speak Turkish.OK! please write me back soon! see you my best friend!
  • Sent by: cihan “göncü” <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • cc: CN=Asim SAKAR/O=Bahcesehir Universitesi@bahcesehir.edu.tr
  • Sent: Tuesday, December 5, 2000 5:37 PM
  • Subject: Re: I'm so sorry...
  • Hi mitsuko! how are you! I know I always ask for you this question but I pession to you. sorry, I didn't sad. you didn't make me sad. you ask me do you use to computer in your house. yes, I use to computer in my house every night.I wanna join to NBA. It's my best dream. Mirsad is first Turkish people joined to NBA,Hidayet second and me hope will be third Turkish people. “I'm very detesting to war.” By the way, I can slam. I can fantastic slam. I don't forget to you,too. when I was join to NBA I will say hi for you on tv. I'm sorry again. see you tomorrow.write me back my best friend... BEST W?SHES, Cihan
  • From: cihan göncü <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • Cc: <asakar@bahcesehir.edu.tr>
  • Sent: Tuesday, December 05, 2000 2:07 AM
  • Subject: Re: Bad Monday :-o
  • Hi Mitsuko! How are you today? I'm fine. I came to school 10 minutes ago. I looked the your mail but I didn't see your mail. Ok! I'm very tired today last lesson I slept. :-D. What did you do today. See you soon. you don't forget write to me email.
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: I'm so sorry...
  • Date: Tue, 5 Dec 2000 23:08:22 +0900
  • I'm sorry to make you sad. But I wanna explain! When you send me in December.4, I read and wrote you soon. And I tried to send it . But my computer was not working. I didn't know how to repair this computer. So my father repaired now!!! Don't be sad, please. If I can't send you for several days, you don't have to be worry. I will not forget you and be your best friend forever !! You seemed to enjoy the baketball match. I was surprised that you enroled 30 points!! You can slam dunk, can't you!!! It's so cool. I think you can join in NBA!! Do you wanna join in NBA? If you can do it, I'm sure to go watching your game. Did you ask me what doing on weekend? I usually go shopping with my friends, do part time job, watch movies, and so on. My part time job is that work at hotel as waitress. The hotel is so wonderful!! I work there only on weekend (5 times a week.) It's not easy to do the job. Anyway, My favorite movies are “MY GIRL”, “MY FRIEND FOREVER”, “PRETTY WOMAN”, and so on.... These are American movies. Can you watch American movies in Turky?? Try to watch them (^o^) !!! By the way, I'm so sorry to hear that your brother had gone in the war.... Does the war continue stil now? Where was it happened? I'm shock to think that people same us killed each other in the world now. Please accept my sympathy in this time of sadness and loss. Atom bomb threw in Hiroshima about 50 years ago. However I don't know very well, I know how cruel it was. I'm sure that it never happen again . Today, I saw the pictures that my friends had been to Turky last month. They also seemed to go to Istanbul. What a wonderful place it is!! They said, “I think Turky is a country mixed Asia and Europe”. I wanna go there. But I don't have enough money... Are there many people have parsonal computers?? Do you use computer at your house? I use it at home every night. See you later. Bye
  • From: cihan göncü <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • Cc: <asakar@bahcesehir.edu.tr>
  • Sent: Thursday, December 07, 2000 4:36 AM
  • Subject: Re: I'm so sorry...
  • Thanks! What's up,too. I said my appearance but I can say again. I have hazel eyes. I have short,brown,wavy hair.I have full lips. I'm tall and well built. So, I played basketball today. I play basketball 6 times a week. Wouv! but, Do you know? I won't play basketball. because I will go to school on tomorrow. Please you write me your cultural activities. See you friend.
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: Thanks !
  • Date: Thu, 7 Dec 2000 23:45:16 +0900
  • Hi! What's the cultural activities? Japanese's ? Well, for example, when we become 20 years old, we go to the congratulatory place wearing KIMONO. The KIMONO is the Japanese traditional fashion. We wear it in special time. And in general, only female do it. When girls become 3 and 7 years old, we wear it and go to the temple and pray about health and so on... When boys become 5 years old, we do same thing. In 3, March, (we call HINAMATSURI) , it's for congratulating little girls. For it, we decorate HINA dolls at own house. It's dolls look like ancient people. There are many things as our tradition . Are there any cultural activities in your country? Please tell me. See you soon.
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: Hi Cihan !
  • Date: Thu, 14 Dec 2000 22:22:20 +0900
  • I stayed at my friends house yesterday. And I checked my Email. But I've not got your mail. I was disappointed... The chrismas is getting nearer. What will you do in chrismas ? In Japan, some young people go somewhere with friends. Maybe, I'll also go somewhere by car. I decolated chrismas tree in my house. How about you ? I'm looking forward to your letter ! I'm waiting yur mail, too. See you later. Bye. Lots of love, Mitsuko
  • Sent by: cihan “göncü” <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • cc: CN=Asim SAKAR/O=Bahcesehir Universitesi@bahcesehir.edu.tr
  • Sent: Tuesday, December 12, 2000 5:37 PM
  • Subject: Re: Hi friend !
  • Hi Mitsuko! I'm fine today. But my Internet finished. see you tommorrow. I will write you letter or mail. you don't forget me because I don't forget you byes!!!
  • Sent by: cihan “göncü” <cihangoncu@yahoo.com>
  • To: Mitsuko Tokunari <mitsukocci@mtb.biglobe.ne.jp>
  • cc: CN=Asim SAKAR/O=Bahcesehir Universitesi@bahcesehir.edu.tr
  • Sent: Friday, December 15, 2000 5:37 PM
  • Subject: Re: Hi Mitsuko!
  • Hi friend! How are you today? I'm very tired because I was very busy yesterday. I went to basketball club and I began training. we always ran trainer always shouted to we. “you are a lazy you don't work you are only a stupid.” you will ask for me. “why did he shout you?” because we lost last match. We were very bed play during the match. I sat. I played 5 minutes I put 4 point their basket. But tomorrow there is a last match. I think we'll win that match. again I'm sorry I can't send mail to you. but you know my internet finished. I'm in the internet cafe now. I'm writing there. Computer is very slovly. so, by the way, I'll go to pub on christmas day. I'll very enjoy. Sorry I don't send a letter because I'don't look my email and I can't your address. ok! see you friend I will buy a new internet and I'll send mail so much. Have a nice christmas day. Bye friend
  • From: “Mitsuko Tokunari” <mitsukocci@mtb.biglobe.ne.jp>
  • To: <cihangoncu@yahoo.com>
  • Subject: Dear my friend.
  • Date: Sat, 16 Dec 2000 19:14:38 +0900
  • How are you today? I'm good. Today, I want to my cousin's wedding party. She is 24 years old, a daughter of my mother's sister. I wore “KIMONO”. I was taken photos. So I wanna send them to you. Can I ask your address ? And please send your photos, too. I've been waiting for your letter. I tell you my address again. 14-4-8, Yachiyodai Kita, Yachiyoshi, Chiba, JAPAN, 276-0031 My name is Mitsuko Tokunari. Why was your Internet finished? Does it have Limit?

Corpus-based computational linguistics: A practical investigation of the procedures involved in the selection, study and exploitation of a relevant corpus

  • ISSN 1442-438X
  • CALL-EJ Online
  • Vol. 3, No. 2, January 2002


  • Sean Romano Maddalena
  • srm@gol.com
  • University of Ashiya, Japan

Abstract

This paper charts a corpus analysis research investigation which was conducted in response to a classroom question. The linguistic features under investigation are “used to” and “be used to”; two grammatical forms whose constructional similarity often causes problems for beginner-level students.
This intentionally limited study outlines, by way of a step-by-step approach, the practical procedures involved in the assimilation and manipulation of computer-generated data. It is hoped that novice investigators may gain some valuable insight as to what even simplistic inquiries can bring for themselves as linguistic theorists, and to their learners embarking on a greater understanding of language meaning and usage.

A Brief History of Corpus Linguistics

Studies of language can be divided into two main areas: studies of structure and studies of use. Corpus analysis (CA) focuses on the second of these, studying actual language used in naturally occurring texts. Ever since Firth (1957) stated that “You shall know a word by the company it keeps”, it has been a practice in linguistics to classify words not only on the basis of their meanings, but also on the basis of their co-occurrence with other words. However, in a purely practical sense it is only in recent times that machines have given us the ability to identify these relationships in a meaningful and significant way.
From the simple listing of words in the Middle Ages by hand, to the earliest corpus-based analyses of literary styles, through to the first modern electronically readable corpus, the Brown University Corpus of American English, (and its close cousins the Lancaster-Oslo/Bergen corpus and the Kolhapur Corpus), the computer-aided analysis of vast amounts of authentic data has come a long way in a very short time. Almost half a century ago Firth (1957: 31) made the following prophetic statement: “The use of machines in linguistic analysis is now established”. John Sinclair (1991: 1) describes the evolution through the last three decades in the following way: “ Thirty years ago when this research started it was considered impossible to process texts of several million words in length. Twenty years ago it was considered marginally possible but lunatic. Ten years ago it was considered quite possible but still lunatic. Today it is very popular”. This popularity has led to an increased understanding of the relationship of meaning to form as formal patterns, previously undetected, have come to light. Sinclair states again, “At the very least, the quality of linguistic evidence is going to be improved out of all recognitionq¥Êt is my belief that a new understanding of the nature and structure of language will shortly be available as a result of the examination by computer of large collections of texts” (1991b: 489). Stubbs (1996) concurs, “computer-assisted analysis of texts and corpora can provide new understanding of form-meaning relations”.
It should be noted that CA involves far more than using computers for the simple counting and quantifying of linguistic features into sets of statistics. Though this may be seen as the first step in a two-stage process, it is the subsequent, qualitative analysis that provides the more revealing evidence “to propose functional interpretations explaining why the patterns exist” (Biber, Conrad & Reppen, 1998: 9). As a practical investigation, however, this paper focuses primarily on the procedures involved in obtaining and manipulating the data required to create a corpus, and while it does present some insight into possible pedagogic considerations and offer tentative conclusions based on corpus generated evidence, its scope is intentionally, limited.

Choosing a Corpus

Source, size and selection
In response to a recent classroom inquiry, the linguistic features under investigation are “used to” and “be used to”; two grammatical forms whose constructional similarity often causes problems for beginner-level students. For the purposes of this investigation I chose to use two established corpora, the Lancaster-Oslo/Bergen Corpus (LOB), of British English established by Geoffrey Leech and Jan Svartvik, and its American counterpart, the Brown University Corpus of American English (Brown), running parallel investigations under different methodological conditions. The two corpora are very similar in design: each taken from a total of some five hundred texts across a wide-range of registers, a combined total of approximately two million words.
Size is a prime concern for successful corpus-based lexicographic research. As Biber et al. warn: “To study the meaning and use of words, we need a very large corpus — a 1-million word corpus will not provide sufficient data for many words to allow for meaningful generalizations” (1998: 30). However, with more common words in a text of this size, frequencies are generally considered to be quite reliable. At a million or so words each, I was hoping that my choice of general purpose corpora would provide enough evidence to sufficiently highlight linguistic elements for possible future pedagogic exploitation.

Methodology

As primarily a practical research study, I chose to conduct this investigation employing a number of differing methods. In the first instance, I examined the LOB corpus using a CD-ROM provided by the International Computer Archive of Modern English (ICAME), running the analysis through a software application, the Aston Text Analyser (ATA), supplied by Aston University. I also used part of the LOB corpus to examine the practical problems one might encounter in the creation of a pedagogic corpus, established corpora not always being readily available for investigation and exploitation.
As a reflection of recent advances in Internet technology, I was also interested in conducting a limited parallel study, making use of an on-line version of the Brown corpus, a free but time-restricted service provided by the University of Pennsylvania's Linguistic Data Consortium, (LDC). Details of distribution and copyright restrictions pertaining to both texts are included, (Appendix C).
It should be noted here that although the Brown corpus is also supplied on the ICAME CD-ROM, I chose not to access it in the traditional way preferring instead to examine the benefits and shortcomings of locating and accessing corpora via the alternative, and increasingly popular, on-line method.

Equipment Used

The study was conducted with the aid of a generic desktop personal computer running the Windows operating system. Software support was provided by the WinATA Mark 2 text analyser, a word processor, MS-Word 97 and an Optical Character Recognition (OCR) program, Caere Omni-Page Pro 9.0 used in conjunction with a flatbed scanner.

Data Input: Scanning and OCR

Equipment and procedure

In some instances, teachers and researchers may not have access to established corpora due to resource limitations. In other cases, most notably for investigations in English for Specific Purposes (ESP), it might be necessary to manually create a specific pedagogic corpus. In creating such a corpus for use in CA, one possible means of inputting data is to scan text directly into a computer using a suitable combination of hardware and software. In order to explore the limitations of such a procedure, I used a Microtek ScanMaker X6 scanner, a low budget flatbed model, together with Caere Omni-Page Pro 9.0 OCR software, which was supplied as part of the scanner package.
For the limited purposes of this exercise, I first selected a section of some five hundred words from my LOB corpus, cut and pasted them into a new document and saved this as a separate text file. This was then printed onto a standard sheet of A4 paper, and then scanned directly into the computer. An almost flawless text conversion is testimony to the development of OCR software in recent times. A few years ago a similar exercise may well have resulted in a bout of severe frustration, even when scanning a simple page of text. These days, more advanced programs such asOmni-Page Pro offer much greater speed, reliability and flexibility, especially when integrated into established word processing applications such as Word and Word Perfect. Carefully scanned pages of text assimilated in this way can form the basis for a ‘personal’ pedagogic corpus, to be subsequently examined by a suitable text analysis program.

Some Points to Note

There are two significant considerations that can effect the quality of the final output from the scanning procedure. Firstly, and most importantly, is the quality and condition of the document that one wishes to scan. I was using a clearly printed black text on a clean sheet of white plain paper. Highly colored, glossy, marked or even creased papers have all been known to cause problems with OCR software. The second consideration relates to the complexity of the document. As my inquiry revealed, regular text is not really a problem for this kind of application. However, when one mixes text, graphics and tables, more time needs to be spent in the setup process before attempting the conversion. I also found in this exercise that the software occasionally flagged correct words simply because they were not in the dictionary it was using.

LOB and ATA

Installation

Installation of the ATA software suite is via CD-ROM. It is important to note during the installation process that in order for the software to function correctly, all files must be extracted into the same location and not into separate folders. Correct installation creates two executable programs; ataIndex and ataInsight which must be run separately, one after the other. The first of these, as the name suggests, creates and indexes the corpus. In the case of LOB, this entails specifying the correct path for the location of the text to be indexed and titling the project appropriately. When the indexing has been completed, it is then necessary to run the second application, ataInsight. This opens an ‘Open ATA project’ window in which the now indexed LOB text can be found. On selecting ‘OK’, the program starts its analysis of the chosen project.

Frequency and filter

My investigation is to specifically look for occurrences of “used to” within the corpus. To do this, it is first necessary to locate “used” from the ‘Word Frequency List’ which opens automatically on the left side of the screen. Selecting this entry, (with ‘Collocations’ checked in the right-button mouse menu) creates a list of contexts in a right-hand window; some 181 entries in total.
Next, it is desirable to refine a little further using the collocation‘Filter’option, reducing the list to those lines containing my chosen sub-string. Adding “to_” to the filter generates a final list of 178 concordances which contain only my target search string, “used to”. By selecting ‘Export’ from the right-button mouse menu, concordances can then be exported with relative ease from within the application and opened in a word processor, ready for tabulation, (Appendix A). From a total of 1,022,828 tokens, the following frequency list is generated. Relative frequencies are out of 10,000:
Fig.1 LOB Corpus frequencies for “to”, “used” and “used to”.

Observations

Presentation, an important consideration not merely for aesthetic purposes, also demands a practical working knowledge of basic word processing operations. Ideally for beginner-level students, concordances are presented in a clear and easy to read tabular format, sorted alphabetically to enable the swift identification of collocation patterns, (Appendix A and Appendix B).

Brown Corpus

As mentioned above, the Brown corpus is accessed through the University of Pennsylvania's LDC internet site. It offers a selection of corpora for real-time analyses though access, as a ‘guest user’ is restricted to twenty days. On acceptance of the user terms and conditions, one is invited to enter the relevant search criteria in a series of selectable fields.
An initial search returns a tagged frequency list, and generates concordances for the identified search pattern. The complete list of Brown concordances is provided in their processed form, (Appendix B).
From a total of 1,189,209 tokens, the following frequency list is generated. Once again, relative frequencies are calculated out of 10,000:
Fig.2 Brown Corpus frequencies for “to”, “used” and “used to”.

Observations

Established corpora are often the culmination of a great deal of time, effort and, most significantly, money. Such investment is jealously guarded and may not, therefore, be made generally available without due considerations of costs. In some cases this may prove to be prohibitive to the less fortuitous researcher. In this light, it can be seen that the ability to access a large on-line corpus in real-time is extremely useful for those unable to avail themselves of the more traditional resources, and also appealing to those who lack the practical wherewithal necessary for the successful exploitation of a complicated text analysis program. Such corpora also offer the added benefit of speed; a list of concordances can be generated in a matter of seconds. However, at this early stage of development the on-line corpus does not yet offer the flexibility or power of a dedicated software package, such as ATA, to sort or to filter, as need dictates.

Analysis

The majority of the concordances in LOB are taken up with “used to” employed to describe past situations and events. There is a visible tendency within the list to collocate with the verb “to be” and also with other common verbs:
    • as fresh as it used to be, though an
    • you herself what she used to be.
    • But then I used to be a racing
    • reading ," wrote Francis Williams,” used to be a Socialist
    The corpus provides twenty-eight instances of “be used to” meaning to be “accustomed to”. The propensity is for the item to collocate with a noun or a verb, notably the gerund. Of the total number, only eleven actually occur with the gerund, which is the collocate most commonly highlighted in beginner-level textbooks. Textbooks also tend to focus on the gerund occurring after the target form:
    • time before I got used to calling them portholes.
    • Clara was used to following his lead
    • seemed to have been used to seeing couples engaged
    whereas LOB offers examples of the gerund occupying a position before the target form:
    • a bit of getting used to
    • She took time getting used to the indoor lavatories
    And a single instance of a noun coming between the two:
    • garage, but he was used to Grant taking his
    A further significant observation is that more than half of the these concordances demonstrate collocations with the verb “get”:
    • You'll have to get used to my bad morning
    • heavy, but one got used to this
    Though not the focus of this particular exercise, the list also provides some examples of the target form performing a third linguistic function, the passive voice:
    • descriptions can also be used to refer to performances
    • ratio decidendi}is normally used to refer to some
    • beggars, a term often used to describe the population,
    • ferromagnetic spinel is sometimes used to describe those ferrites
    With Brown, as with LOB above, “used to” describing past events tends to collocate with the verb “to be” and other common verbs:
    • eem high, but they used to be even higher,
    • spe said, This soil used to be like that
    • ard roll. <s> This used to be part of
    Also present, as noted in LOB, are instances of “used to” employed in the passive voice:
    • ma. The method used to scan the eye
    • I rand, IOCSIXG, is used to specify the second
    The Brown corpus offers twelve examples of “used to” meaning to be “accustomed to”; less than half of the total number present in LOB. Of these, only five collocate with the gerund:
    • ke a little getting used to — not because it
    • ur people have been used to accepting things as
    • that must have been used to booming, `` and th
    • he governor was not used to having his integrit
    • jealous. <s> He's, used to me bringing home
      and only twoof the twelve co-occur with the verb “get”:
    • ke a little getting used to — not because it
    • little time to get, used to. After a

    Possible Pedagogic Applications

    In the classroom, concordances produced through the analysis of a suitable corpus can provide valuable data for the testing of existing grammatical models and practical material for the production of cloze exercises. Closer examination can also reveal patterns and constructions that may not be covered in prescribed textbooks.
    The initial intent of this study was to examine the differences in usage between “used to” and “be used to”. My learners do not have a significant problem with the former, but do express confusion when attempting to differentiate it from the latter. My institution's current choice of text only instructs in the use of “be used to” co-occurring with the gerund and, consequently, my students have only been exposed to this construction in their English classes. However, the majority of these concordances in Brown and LOB occur with no gerund at all, a point worthy of highlighting in the classroom. Though different in meaning, the number of cases of “get used to” provided by the corpora, most prominently LOB, may be seen as noteworthy and also deserving of my students' attention, as this particular construction is not covered in the students' textbook at all. A practical pedagogic approach to both of these issues would be to expose my students to the corpus-generated data as part of a series of carefully coordinated lessons. Through the insights I have gained in the course of this particular study, my eventual aim would be to bring CA directly into the classroom, possibly as part of the school's regular computer studies classes, and allow my students to join the investigation as part of a hands-on practical exercise.
    However, to add a note of caution, as my own small investigation reveals, there are significant differences in both frequency and usage to be found even across two very ‘similar’ corpora. It is important therefore to make only tentative inferences regarding grammatical rules or patterns of use and to acknowledge the limitations of dealing with such a small sample of data. A future piece of research conducted on a much larger text might allow for some more definite conclusions to be made.
    A further possible pedagogic option, requiring an extension of this study, would be to heed the advice of Willis & Willis (1996) and Peacock (1997: 152) to produce a set of authentic materials: “materials which are used in genuine communication in the real world” (Wong, Kwok & Choi, 1995: 318), taken from a spoken, rather than written, corpus and to investigate specifically any increased signs of motivation with my less-conscientious learners.
    It is perhaps a fitting conclusion to note that in the course of writing this paper a further development in the evolution of computational linguistics and the internet is reported: ICAME is now the latest in a growing number of institutions offering on-line access to all of its corpora, in this case to registered users of its commercially available CD-ROM. It seems likely that such innovations, offering increased levels of accessibility to an ever-growing body of linguistic data, will continue into the foreseeable future.

    References

    • Biber, D., Conrad, S., & Reppen, R. (1998).CORPUS LINGUISTICS: Investigating Language Structure and Use. Cambridge: Cambridge University Press.
    • Brown University Corpus of American English.
    • University of Pennsylvania, Linguistic Data Consortium: http://www.ldc.upenn.edu/
    • Firth, J. R. (1957). A synopsis of linguistic theory. Studies in linguistic analysis. Oxford: Oxford University Press.
    • Lancaster-Oslo/Bergen corpus (1961). International Computer Archive of Modern English. Bergen, Norway.
    • Peacock, M. (1997). The effect of authentic materials on the motivation of EFL learners. ELTJ, 51(2), 144-156.
    • Sinclair, J. (1991). Corpus, Concordance, Collocation. Oxford: Oxford University Press.
    • Stubbs, M. (1996). Text and Corpus Analysis. London: Blackwell.
    • Willis, J. & Willis, D. (1996). Consciousness-raising activities. In Willis, D. & Willis, J. (Eds.), Challenge and Change in Language Teaching. London: Heinemann.
    • Wong, V., Kwok, P. & Choi, N. (1995). The use of authentic materials at tertiary level. ELTJ, 49(4), 318-322.

    Author

    Sean Maddalena holds a first degree in Law, a Diploma in TEFL and an MSc in TESOL from Aston University. Originally from the United Kingdom, he has made his home in Japan since 1989 and is currently employed by Ashiya University. His specific research interests include Course and Syllabus Design and Computational Linguistics.

    Appendix A

    a bit of gettingq_
    used toq_ .
    plane can only beq_
    used toq_ a limited extent
    of the man habituallyq_
    used toq_ a shoulder-holster .
    such computers can beq_
    used toq_ advantage when a
    Gissingq_
    used toq_ ask ~ * ' Has he
    affluent society should beq_
    used toq_ assist the less
    Rolled barley isq_
    used toq_ balance grass or
    as fresh as itq_
    used toq_ be , though an
    you herself what sheq_
    used toq_ be .
    man myself though : Iq_
    used toq_ be a { 0G.P . }
    But then Iq_
    used toq_ be a racing
    reading , " wrote Francis Williams , "q_
    used toq_ be a Socialist
    done by administrative actq_
    used toq_ be accomplished in
    the subject Social Psychologyq_
    used toq_ be called Home-making
    of the May songq_
    used toq_ be current in
    Itq_
    used toq_ be fancier , but
    At one time " mind * * "q_
    used toq_ be identified with "
    of their larger carsq_
    used toq_ be made available
    her hair , it neverq_
    used toq_ be quite that
    This lessonq_
    used toq_ be read only
    Sometimes that pleasant Citroenq_
    used toq_ be subject to
    Harry of the jointq_
    used toq_ be the barman
    Thereq_
    used toq_ be three separate
    I was younger Iq_
    used toq_ be what is
    Like heq_
    used toq_ be years ago . . .
    three feet long butq_
    used toq_ being handled , in
    of the gold filletsq_
    used toq_ bind up the pŽº/span>
    Miniature cedar trees areq_
    used toq_ block out the
    technical school ) should beq_
    used toq_ broaden the youngsters '
    British sources have beenq_
    used toq_ calculate the effective
    time before I gotq_
    used toq_ calling them portholes .
    I alwaysq_
    used toq_ clean my rifle
    Heq_
    used toq_ come every day
    Heq_
    used toq_ come to Pierre's
    remember a woman whoq_
    used toq_ come to see
    at Saintes , has beenq_
    used toq_ complete the drawing
    have been or areq_
    used toq_ control impurity build
    is what bedizened boysq_
    used toq_ dance before Mogul
    its phrases , especially thoseq_
    used toq_ describe a visit
    Kunst wasq_
    used toq_ describe certain branches
    with the conventional equationsq_
    used toq_ describe fluxes in
    unit , can be properlyq_
    used toq_ describe soils in
    a root that isq_
    used toq_ describe the herding
    as the wave functionsq_
    used toq_ describe the motion
    equation can indeed beq_
    used toq_ describe the motion .
    however , they may beq_
    used toq_ describe the motions
    beggars , a term oftenq_
    used toq_ describe the population ,
    ferromagnetic spinel is sometimesq_
    used toq_ describe those ferrites
    method of measurement wasq_
    used toq_ determine accurately the
    year group was thenq_
    used toq_ determine what would
    his Cambridge days , heq_
    used toq_ display a corresponding
    elaborate dresses than theyq_
    used toq_ do .
    Mould many years backq_
    used toq_ do .
    Peopleq_
    used toq_ do all their
    strain , the two beingq_
    used toq_ draw true stress /
    young the Royal Navyq_
    used toq_ drink it before
    Heq_
    used toq_ drink the cheap ,
    that report has beenq_
    used toq_ estimate the theoretical
    diametrically opposed contacts wereq_
    used toq_ facilitate the observation
    gouge , and the fileq_
    used toq_ finish off .
    the former crop beingq_
    used toq_ finish off the
    Clara wasq_
    used toq_ following his lead ,
    The method wasq_
    used toq_ forecast visibility ( as
    concrete tube sections beingq_
    used toq_ form the sump
    smoothing plane can beq_
    used toq_ form the taper .
    Bank years ago weq_
    used toq_ get good hauls , 12
    song , told me : Weq_
    used toq_ get up at
    This solution may beq_
    used toq_ give the contribution
    those places where weq_
    used toq_ go .
    much as Cecil Sharpq_
    used toq_ go about in
    Sheq_
    used toq_ go about the
    garage , but he wasq_
    used toq_ Grant taking his
    Iq_
    used toq_ hate Creedy , when
    for a drink heq_
    used toq_ have his grouse .
    The Caxtonsq_
    used toq_ have their holidays
    told me " I alwaysq_
    used toq_ hear a lot
    Weq_
    used toq_ hear talk about
    took time to becomeq_
    used toq_ hearing so much
    household possessions may beq_
    used toq_ help with the
    Apparently heq_
    used toq_ hide it in
    they may be fruitfullyq_
    used toq_ His Glory .
    and these can beq_
    used toq_ illustrate the type
    overclothe them as theyq_
    used toq_ in the old
    The term quasi-classical isq_
    used toq_ indicate that their
    growth equilibrium " paths , areq_
    used toq_ investigate the stability
    man , if you aren'tq_
    used toq_ it , * * ' he heard
    You'll getq_
    used toq_ it , adorable baby .
    that we should getq_
    used toq_ it .
    I never gotq_
    used toq_ its travel-film colours
    Two methods can beq_
    used toq_ join the crochet
    differences between jobs beq_
    used toq_ justify differences in
    a young man , weq_
    used toq_ keep strictly to
    to meet people Iq_
    used toq_ know , to see
    electric effect can beq_
    used toq_ launch ultrasonic waves
    Iq_
    used toq_ lie awake planning
    a counter-irritant almost Iq_
    used toq_ listen of nights
    Marc Chagallq_
    used toq_ live here and
    Then that's why * - " " Heq_
    used toq_ live in Tangier , "
    Theyq_
    used toq_ look * - and some
    of an elephant , wasq_
    used toq_ make a cake
    Some separated lead-210 wasq_
    used toq_ make reference standards
    crochet lace can beq_
    used toq_ make tablecloths , traycloths
    provision which was nowq_
    used toq_ make the { 0T.E .
    ancient Britons , I believe ,q_
    used toq_ make water hot
    as it is nowq_
    used toq_ mark a paragraph
    Section the term wasq_
    used toq_ mean something like
    Georgeq_
    used toq_ mix 100 stone of
    junior to Humbert , whoq_
    used toq_ mock him affectionately
    You'll have to getq_
    used toq_ my bad morning
    gauge can now beq_
    used toq_ nick in the
    three following winters wereq_
    used toq_ obtain an independent
    Heq_
    used toq_ organise film shows
    which can then beq_
    used toq_ perform an operation .
    and devices to beq_
    used toq_ perform the various
    Iq_
    used toq_ play about in
    Iq_
    used toq_ play rugger , * * ' said
    lead carrier solution isq_
    used toq_ prepare the reference
    how Alexander the Greatq_
    used toq_ recline and transact
    descriptions can also beq_
    used toq_ refer to performances
    ratio decidendi } is normallyq_
    used toq_ refer to some
    it may have beenq_
    used toq_ relate Christ's healing
    migre * ? 2s , who notoriouslyq_
    used toq_ repair to the
    she said chattily , Iq_
    used toq_ ride a bicycle .
    and personality which journalistsq_
    used toq_ ridicule , can be
    the gate the cockerelq_
    used toq_ run to meet
    for you fellows , * * ' heq_
    used toq_ say , you can
    Laughable , theyq_
    used toq_ say .
    Heq_
    used toq_ say : ^ Have whatever
    Of Kitchener heq_
    used toq_ say with humorous
    reminiscent of what weq_
    used toq_ see pŽ®St .
    seemed to have beenq_
    used toq_ seeing couples engaged
    embarrassment if she isq_
    used toq_ seeing her mother
    that force should beq_
    used toq_ settle this problem .
    the May carol heq_
    used toq_ sing , with his
    me the one sheq_
    used toq_ sing in Kimbolton
    a shaped rubber isq_
    used toq_ smooth the hollow
    was young schoolboy I
    used toq_ sneak off to
    Sheq_
    used toq_ solve all the
    the clinical weekends heq_
    used toq_ spend with her .
    applied , and every meansq_
    used toq_ stop the train ,
    in contrasting tones wereq_
    used toq_ strengthen garments at
    model which may beq_
    used toq_ study both the
    Heq_
    used toq_ stump round the
    possibility of power beingq_
    used toq_ supplement hand tools .
    Iq_
    used toq_ take the small
    and colleague , Campbell Dixon ,q_
    used toq_ tell of a
    The straight-edge can beq_
    used toq_ test the straightness
    is bought , can beq_
    used toq_ the best advantage .
    at ( B ) . A malletq_
    used toq_ the chisel is
    become ( 1 ) tired , or ( 2 ) moreq_
    used toq_ the disturbance .
    Soho , to get meq_
    used toq_ the food , he
    might as well getq_
    used toq_ the idea .
    they very quickly getq_
    used toq_ the idea of
    She took time gettingq_
    used toq_ the indoor lavatories
    They'req_
    used toq_ the snatch racket .
    that most people getq_
    used toq_ them .
    Jane wasq_
    used toq_ these sudden exigencies
    or chieftain to getq_
    used toq_ these trimmings because
    to tinsel compliments , weq_
    used toq_ think him unworldly ,
    in an Embassy * - Iq_
    used toq_ think it was
    heavy , but one gotq_
    used toq_ this .
    You are not yetq_
    used toq_ this sort of
    decorative kale are convenientlyq_
    used toq_ tone in with
    horses ; they had beenq_
    used toq_ trains since they
    The brush contacts wereq_
    used toq_ trigger off a
    He oftenq_
    used toq_ try to imagine
    His friendsq_
    used toq_ try to persuade
    friend , William James , whoq_
    used toq_ urge that the
    in London that Jonesq_
    used toq_ use in the
    slaves * - everything he wasq_
    used toq_ using while he
    a literary province Iq_
    used toq_ visit fairly often ;
    Sheq_
    used toq_ walk straight to
    Heq_
    used toq_ walk to the
    page , would have beenq_
    used toq_ weigh bales of
    They could beq_
    used toq_ weigh several sacks
    its simplest form itq_
    used toq_ work in the
    they are a teamq_
    used toq_ working together , they
    like that she hadq_
    used toq_ write to me .

    Appendix B

    ke a little gettingq_q_
    used to -- not because it
    iling teasing as heq_q_
    used to . <p> <s> `` Huskyq_q_q_q_
    from it that sheq_q_
    used to . <p> <s> `` You
    little time to getq_q_
    used to . <s> After a
    ur people have beenq_q_
    used to accepting things as
    a new melody isq_q_
    used to accompany his narraq_q_q_
    repetitious The logical schemeq_q_
    used to accomplish the formq_q_q_q_
    residual hese inquiries wereq_q_
    used to adjust compilationsq_q_q_ tient
    uestions . <s>I 'mq_
    used to all three , but
    herse one hebephrenic manq_q_
    used to annoy me , month
    ageq_ seven-iron shot heq_q_
    used to approach the greenq_q_q_q_
    s> They could beq_q_
    used to attack a nation '
    platform and can beq_q_
    used to automatically holdq_q_q_q_ iling
    citiz--uglier than youq_q_
    used to be , and you
    ss glorious than itq_q_
    used to be , it is
    nistered here as itq_q_
    used to be , with unleaveneq_q_q_
    or less than itq_q_
    used to be ? ? <p> <s>
    eem high , but theyq_q_
    used to be even higher '' ,q_q_q_
    spe said , This soilq_q_
    used to be like that
    ard roll . <s> Thisq_q_
    used to be part of
    as e Catskills , whichq_q_
    used to be the summer
    that must have beenq_
    used to booming , `` and th
    ese profiles can beq_q_
    used to calculate a temperaq_q_q_
    feeli ransports that wereq_q_
    used to carry Communist ageq_q_q_q_
    the mails were thenq_q_
    used to carry it out '' . <q_q_q_q_
    tional codes can beq_q_
    used to challenge and countq_q_q_q_
    and d Margaret recall ,q_q_
    used to characterize her asq_q_q_ >
    les of crystals areq_q_
    used to classify and identiq_q_q_
    of materials can beq_q_
    used to construct a satisfaq_q_q_
    cattle of thousand spectatorsq_q_
    used to crowd it in
    holes and can beq_q_
    used to cut exact-size discq_q_q_
    the words he hadq_q_
    used to defend Cromwell . <q_q_q_ he
    grea emical methods wereq_q_
    used to demonstrate the renq_q_q_
    K factor , a termq_q_
    used to denote the rate
    s> Mines can beq_q_
    used to deny access to
    elastic resonance shifts isq_q_
    used to derive a general
    was a Spanish wordq_q_
    used to describe cattle ofq_q_q_q_
    s ,sometimes it isq_q_
    used to describe felt humanq_q_q_
    integritq_ ind words travelersq_q_
    used to describe Little Rocq_q_q_
    prbody temperature isq_q_
    used to describe the radiatq_q_q_
    e aircraft could beq_q_
    used to destroy other mobilq_q_q_
    ese sound waves areq_q_
    used to detect submarines ,q_q_q_ ma . <
    the the anonymous Womanq_q_
    used to do , and he
    each time as heq_q_
    used to do . <s> When
    second aerated lagoons beq_q_
    used to eliminate the problq_q_q_
    h tiles , marble areq_q_
    used to emphasize the feeliq_q_q_
    ve operation EQU isq_q_
    used to equate symbolic namq_q_q_
    d transom which wasq_q_
    used to fasten them to
    a satisfa lf-unloading wagonsq_q_
    used to fill silos spreadsq_q_q_q_
    tten 2 B filter wasq_q_
    used to filter off residualq_q_q_
    er last week ,Iq_q_
    used to follow Williams eveq_q_q_
    power which can beq_q_
    used to frustrate the citizq_q_q_q_ --
    atement may also beq_q_
    used to generate an RDW
    old days when `` weq_q_
    used to get the seamen
    af A hebephrenic manq_q_
    used to give a repetitiousq_q_q_q_q_
    was another . <s> Iq_q_
    used to go with Watson
    mulated that can beq_q_
    used to good advantage . <pq_q_q_
    eel lonely , and weq_q_
    used to hang a sign
    aps as the cave-menq_q_
    used to have in the
    he governor was notq_
    used to having his integrit
    and had already becomeq_
    used to Hesperus ' snappingq_q_q_ he
    eem strange to earsq_q_
    used to hillbilly and jazz
    and he was notq_q_
    used to horseback . <s> Now
    ngs Thorpe, can beq_q_
    used to illustrate anotherq_q_q_q_q_ power
    vocatio pleading cannot beq_q_
    used to impose unnecessaryq_q_q_q_ h
    nk together like weq_q_
    used to in the old
    the progr `` technology '' isq_q_
    used to include any and
    of time is merelyq_q_
    used to increase the realisq_q_q_
    mobil rrently , marina isq_q_
    used to indicate a municipaq_q_q_q_ **
    w seldom they did :q_q_
    used to it , probably . <s>
    n tactics have beenq_q_
    used to justify like tacticq_q_q_q_
    spreads Computers are beingq_q_
    used to keep branch inventoq_q_q_ <
    the new jail , weq_q_
    used to keep prisoners in
    ng cover , could beq_q_
    used to keep the wastes
    the eye . <s> Weq_q_
    used to kid him by
    ny ? ? <s> He neverq_q_
    used to like any hot
    cereal aining appliance isq_q_
    used to lock them in
    c. <s> The Presidentq_q_
    used to look at it
    by the same methodq_q_
    used to look up a
    ith , Styka . <s> Iq_q_
    used to love this country
    he coconut palm areq_q_
    used to make candles in
    as urposes -- also areq_q_
    used to make soaps , detergq_q_q_
    of public places thatq_q_
    used to make the Jew
    zon apabilities must beq_q_
    used to maximum advantage tq_q_q_q_ . <
    jealous . <s> He 'sq_q_
    used to me bringing home
    count mimesis '' is hereq_q_
    used to mean the recallingq_q_q_q_q_
    if it could beq_q_
    used to measure the elasticq_q_q_
    s> Sonar can beq_q_
    used to measure the thickneq_q_q_
    radiat ed thermocouple wasq_q_
    used to measure the upstreaq_q_q_
    aratus will also beq_q_
    used to measure transitionq_q_q_q_ ese
    s steel screws wereq_q_
    used to minimize corrosionq_q_q_q_ e
    The DA statement isq_q_
    used to name and define
    The DC statement isq_q_
    used to name and enter
    sample ; e bio-assay methodsq_q_
    used to obtain them . <s>
    tient of mine , whoq_q_
    used to often seclude herseq_q_q_
    s> yesterday .<s> Youq_q_
    used to paint in them ,
    ly state funds wereq_q_
    used to pay for the
    as a child Iq_q_
    used to play '' . <s> He
    he corner where youq_q_
    used to play when you
    very summer . <s> Iq_q_
    used to play with the
    out ''surpluses had beenq_q_
    used to provide a private
    ce forces have beenq_q_
    used to provide defense zonq_q_q_
    she ed aluminum plate ,q_q_
    used to provide the dryingq_q_q_q_
    asq_ Miss Giles alwaysq_q_
    used to refer to her
    most of what weq_q_
    used to regard as the
    ntic up there , sheq_q_
    used to say , with the
    of my ewish intellectualsq_q_
    used to say . <p> <s>
    se by instinct , heq_q_
    used to say : such places
    The party that wonq_q_
    used to say something aboutq_q_q_
    ma . <s> The methodq_q_
    used to scan the eye
    S statement must beq_q_
    used to select the major
    stem . <s> DIOCS isq_q_
    used to select the major
    b '' . <s> It isq_q_
    used to separate two or
    s> The symbol isq_q_
    used to separate two or
    foam and can beq_q_
    used to slit continuous sheq_q_q_
    me rand , IOCSIXF , isq_q_
    used to specify the first
    I rand , IOCSIXG , isq_q_
    used to specify the secondq_q_q_q_q_
    upstrea equency starter wasq_q_
    used to start the arc . <
    erb garden was alsoq_q_
    used to stop bleeding , andq_q_q_
    a lock ,which isq_q_
    used to store cumulative req_q_q_q_
    Throu was constructed andq_q_
    used to study transition prq_q_q_
    corrosion e been successfullyq_q_
    used to suggest ways to
    than to an Americanq_q_
    used to summers in New
    pirical data can beq_q_
    used to support whatever prq_q_q_
    sort of thing thatq_q_
    used to take place in
    e evening . <s> Sheq_q_
    used to tell me , `` When
    South nt this opportunityq_q_
    used to tell them about
    ygous Af cells wereq_q_
    used to test each sample ;q_q_q_q_
    invento <s> Where Americansq_q_
    used to think of a
    unt of a machine-familyq_q_
    used to this very day
    he enemy-Jew can beq_q_
    used to transform the ordinq_q_q_
    i er , Model 565 , isq_q_
    used to transport the boatq_q_q_q_
    was a trick theyq_q_
    used to try and conceal
    San Juan , but Iq_q_
    used to work on a

    Appendix C

    Copyrights and distribution:

    LOB Corpus:

    The corpus and accompanying manual are available at cost to bona fide researchers through the International Computer Archive of Modern English (ICAME), at the Norwegian Computing Centre for the Humanities, Bergen, Norway.
    The following restrictions on the use of the material must be strictly observed:
    • No copies of the corpus, or parts of the corpus, are to be distributed under any circumstances without the written permission of ICAME.
    • Print-outs of the corpus, or parts thereof, are to be used for bona fide research of a non-profit nature. Holders of copies of the corpus may not reproduce any texts, or parts of texts, for any purpose other than scholarly research without obtaining the written permission of the individual copyright holders, as listed in the manual ccompanying the corpus.
    • Commercial publishers and other non-academic organizations wishing to make use of part or all of the corpus or a print-out thereof must obtain permission from all the individual copyright holders involved.

    Brown Corpus:

    The Linguistic Data Consortium grants to you a license to use this data subject to the following understandings, terms and conditions:
    1. Permitted Uses.
      • This data may only be used for linguistic research.
      • Small excerpts of text or audio data from LDC-Online materials may be displayed to others or published in a scientific or technical context, solely for the purpose of describing the research and related issues. Statistics and other summaries of LDC-Online materials may also be published in the same context. Except for such publication of small excerpts or statistical summaries in scientific or technical works, neither LDC-Online materials themselves, nor access to them, may be sold or transferred to others.
    2. Access by Individuals.
      • To access this data, you must be a staff member, consultant, or individual providing service or doing research at an organization that is a member of the LDC, and you must agree to this user agreement and its provisions. You must terminate your access when these conditions no longer apply.
    3. Copyright.
      • Except as specifically permitted above the display, reproduction, transmission, distribution or publication of the these databases is prohibited.
      • Violations of the copyright restrictions on the data may result in legal liability.