Escuchar
This two-week 40-hour course will cover key issues in language test design and validation. The course will be held at the Universidad de Jaén (Spain) from June 17th to June 28th 2024.
During the first week we will define and learn how to design the main parts of a test: construct, specifications, components (listening, reading, writing, speaking and interaction), through theoretical and practical sessions. Participants will have the opportunity of sharing their own work with colleagues from other institutions and major examining boards.
During the second week we will focus on the statistical analysis of aspects related to validity arguments. We will use both Classical Test Theory and Item-Response Theory to analyze facility values, discrimination indexes, internal reliability, variable maps, etc. and we will see how analytic scales can be validated through Rasch models. No previous knowledge of statistics is necessary.
The course will be taught by experts in language test design with extensive experience: Brian North, co-author of the Common European Framework for Languages and the Companion Volume (1.5 hours); Adolfo Sánchez, expert on mediation at the Universidad de Granada (2 hours); Javier Fruns, Head of language assessment at the Instituto Cervantes (4 horas); David Bradshaw, Senior assessment Services and Recognition Manager for Cambridge University Press and Assessment (4 hours); Carmen Álvarez, Assessment coordinator at the Language Center of the Universidad Politécnica de Madrid (4 hours) and Joaquín M. Cruz, Deputy Director and Assessment Coordinator at the Center for Higher Studies in Modern Languages at the Universidad de Jaén (24.5 hours).
The course will be held in English but its theoretical and practical contents can be applied to test development and validation in any language other than English. Computers will be necessary for the second week. The Universidad de Jaén will provide participants with the necessary computers and pre-installed software, chiefly Word, Excel, SPSS, Winsteps and Facets. Participants who want to use their own laptops will have to make sure that they have access to the aforementioned software because the University of Jaén will not provide individual licenses. According to Spanish regulation, this course is considered as a Diploma de Postgrado (postgraduate course) worth 5 ECTS credits.
If you need any assistance or if you have any questions, do not hesitate to contact the Director of the diploma, Dr. Joaquín Cruz (jtrapero [arroba] ujaen [punto] es; +34683750037).
This course will have 10 sessions. Most of these sessions will include 2 hours of theory and 2 hours of practical work with a 30-minute break. During the first week (17-21 June 2024) we will define and work on the main parts of a test. During the second week (24-28 June 2024) we will focus on statistical analysis using Classical Test Theory and Item-Response Theory. No previous knowledge of statistics is necessary. Participants do not have to work outside the lesson hours and they will receive a link with the materials for the course one week before its beginning. The content of both weeks is broken down as follows:
Week 1
- Introduction
- Listening comprehension
- Reading comprehension
- Oral and written production
- The CEFR CV, mediation and new challenges in language assessment
Week 2
- Introduction to statistical analysis and Classical Test Theory (I)
- Classical Test Theory (II)
- Item Response Theory (I, item analysis)
- Item Response Theory (II, rating scale analysis)
- Wrap-up and guided visit to the campus
During the first week there will be an optional afternoon session in which participants will have the opportunity of sharing the work that they carry out in their institutions. There will also be a gala dinner to be celebrated on Friday 21st at the main hall of the local Castle of Santa Catalina.
The last day of the course participants will be offered a guided visit to the main facilities of the campus, which includes a visit to our private art collection Cesáreo Aguilera, which currently has on display several pieces by Picasso and Tàpies among other modernist artists.
The fee for the course is 250€ and it grants access to all necessary materials, including computers and software. Registration will remain open until June 1st 2024. There are only 15 available places in the course which will be allocated on a first-come-first-served basis.
To register, FILL IN THIS FORM with your information. Within 48 hours of filling the form you will receive an email message with instructions to proceed with the payment. Notice that your participation in the course will only be confirmed upon the payment of the fees.
If you have any doubt or problem during the registration process, do not hesitate to contact the Director of the course, Dr. Joaquín Cruz (jtrapero [arroba] ujaen [punto] es; +34683750037).
Participants must be over 18, have a university degree, an interest in language test development and validation and a minimum B2 CEFRL level in English. Read below the opinion of some of our previous students.
Hana Romova
Language Department of the Police Academy of the Czech Republic in Prague
The title of this course on the CERCLES website immediately caught my attention because it was not only in English, but also professionally focused on language testing and unique in that respect. Although I am not a professional language tester, language testing is part of our work. These two weeks at the University of Jaen gave me an overview and insight as well as hands on practice of language testing based on in-depth theory and practical part including statistics, without having to have a background in statistics. The professional network that comes from this and meeting other colleagues from all over the world is an invaluable experience. I can highly recommend this postgraduate course for further professional development.
Pilar Rodríguez Arancón
Director of the language center of the Universidad Española a Distancia
The course is interesting and practical. Although you might start by thinking that statistics are not for you, as I did, Joaquín will make sure that you never feel disengaged or lost and will guide you from the understanding of tough concepts (such as a ‘construct’) to creating and analysing the quality of your own tests. As students, we all felt that we were on holidays surrounded by very nice people who wanted to learn and had a very different set of skills and knowledge that enriched every session… although we were in scorching Jaén in July after a tough academic year. What can be a better testimony to the quality of the content and the layout of the course, the instructors and the welcoming attitude of all those involved than that?
Zilal Meccawy
Assistant Professor, King Abdulaziz University, Jeddah, Saudi Arabia (currently Visiting scholar at Manchester Metropolitan University, UK)
It was a great experience attending this course as it was informative and instructive, linking our minds to ideas and possibilities in assessment. What I acquired from the training was more than what I expected in terms of statistics in the second week. I am looking forward to incorporating what I learned into my teaching and I am anticipating attending more of this training in the future because of its importance to learning and teaching in general and to English language testing and assessment specifically. I have also enjoyed walking around the beautiful city of Jaén, exploring the university campus and the modern student library and practicing my Spanish!
Olga Naranjo Travieso
Official Language School lecturer and technician at the Consejería de Educación, Universidades, Cultura y Deportes of the Canary Islands
Since I became a teacher for Official Schools of Languages in Spain (2004) my main working goals have been focused on keeping updated my foreign language domain and introducing new concepts and approaches improving my teaching methodology Assessment and designing well balanced, validated and consistent proficiency tests has become our priority since our institution is in charge of certifying CEFR levels in Spain. Last summer (July,2022) I had the honor of being accepted as one of the 15 members of this first postgraduate course (worth 5 ECTS credits) edition sharing the experience with talented European and Spanish professionals in Language Design and Validation. This course takes place at the Centre for Higher Studies in Modern Languages (CEALM) at the University of Jaen, Spain. We had the enormous privilege to be lectured, for two intensive weeks, by the top experts in Language Test Design and Assessment in Europe. It was a hard, but well-worth the time and effort, professional challenge. Thank you very much for the opportunity.
Jackie Robbins
English lecturer at the Universitat Oberta de Catalunya
The LTDV course was extremely useful for me as I'm involved in designing language tests at my university, both for course tests and our university's ACLES English test. The course materials provided were very complete and these were presented at a good pace, but there was also time for reflection and practice. The presenters were all very knowledgeable and offered fascinating insights into all aspects of language test design. The second week, which focused on statistical validation, was presented in an accessible way for those with more or less prior experience and we were given plenty of opportunities to practice what we learned. I'd thoroughly recommend the course to anyone interested in language testing!
Mariana Burak
Academic director at School of Ukrainian Language and Culture at the Ukrainian Catholic University
The course went above and beyond my expectations! The design and administration were truly exceptional. It covered not only the fundamental test theories and item development principles but also provided valuable insights from reputable institutions like Cambridge Press and Assessment, the Institute of Cervantes, and of course the University of Jaén. This exposure allowed us to explore diverse testing perspectives and practices, empowering us to choose the most relevant ones for our specific testing scenarios. The instructors, who were esteemed researchers, played a crucial role in the success of the program. Their openness to discussions and willingness to assist us were invaluable. Notably, lectures by the prominent language assessment researcher Dr. Joaquin Cruz on statistics equipped us with rare knowledge applicable to language assessment mediation and rating scale analysis. Despite our limited background in statistics, the well-structured instruction and Dr. Cruz's manual enabled us to grasp test analysis and validation procedures, providing us with skills we never thought possible as linguists. Upon completion of the course, we not only gained new skills and knowledge but also acquired a wealth of additional resources for continuous development. Furthermore, the course facilitated the establishment of a supportive network of experts and colleagues, instilling confidence in undertaking new testing projects.
Daniela Cerutti
Coordinator at the language center of the Universitat de València
I enrolled in the course with very high expectations, and they have been met. What I have learned in the course is proving to be an essential working tool in my day-to-day work as an accreditation test coordinator. The experience and the preparation of the teaching staff have helped me to resolve many doubts and to consider changes in our assessment tests. The practical work has allowed me to work in a group and to learn from my colleagues in the same profession. The other fundamental aspect is the professional network that I have been able to build with my colleagues on the course. I would definitely repeat the experience.
Dean Custer
Coordinator of English exams at the University of Castilla-La Mancha
When I first saw the advertisement for this course, the thought of spending two weeks in July in the heat that Jaen is so famous for wasn’t exactly the plan I had envisioned for my summer holidays. But I decided to sign up and I’m so glad I did. The course was extremely well organized and we learned a lot about test design and analysis from the various experts that led each session. In addition, the friendships that were made and the network that we created over those two weeks has proved to be the most invaluable part of the whole experience.
Barbora Bulantová
PhD student at the Faculty of Arts, Charles University
The course provides a good balance of theoretical and practical knowledge, making it very useful for both experienced language test designers and novice researchers like me. My Ph.D. project entails developing and validating vocabulary tests for advanced English learners. After completing the course, I felt confident enough to conduct a Rasch-based validation of my tests without having a background in statistics. I also acquired skills needed for designing and validating high-stakes proficiency tests, which I plan to pursue in the future.
Traveling and accommodation
If you need any assistance while preparing your stay in Jaén, do not hesitate to contact the Director of the diploma, Dr. Joaquín Cruz (jtrapero [arroba] ujaen [punto] es; +34683750037). He will be more than happy to recommend the best option for you and to help you in case you need local help.
As regards traveling, he closest airport to Jaén is the airport of Granada, which is only one hour away by bus. You can also fly to Seville or Málaga and then take a bus or a train to Jaén. The international airport of Madrid is also a good option since it is well communicated by train.
There are several hotels for your accommodation in Jaén. Hotel Infanta Cristina is within a 15-minute walk from the venues of the course. If you want to be downtown, you can choose Hotel Xauen, Hotel Europa or Hotel Condestable Iranzo. There is also the possibility of choosing the university dorm of the Universidad de Jaén, the Colegio Mayor Domingo Savio, which is opposite the venues of the course and whose prices you can check here. This is the cheapest and most convenient option, but notice that you may have to share the facilities of the dorm with regular students.
We have free parking space in case you decide to travel by car. The parking lot is open from Moday to Friday from 8:00 until 21:00.
Visit the province of Jaén
In the capital you can visit the Cathedral or the local Castle of Santa Catalina, where the gala dinner of the course will be held. We also recommend you to visit the Museum of Iberian Art, the only museum of its kind in the world, and the Arabian Baths, the biggest in Europe. During the weekend you can also prepare visits to different parts of the province such as Úbeda and Baeza, two world heritage cities which you can reach by bus. If you like nature, you can also visit the Parque Natural de Cazorla, Segura y Las villas.
Enjoy our gastronomy
If there is something that stands out in Jaén it is gastronomy. We are the top producers in the world of extra virgin olive oil (known as AOVE from the Spanish Aceite de Oliva Virgen Extra). We recommend you to visit local shops and check our world famous selection of AOVEs Jaén Selección, a choice of the best AOVEs in the world which can be bought in most shops downtown.
We are also known by our Tapas. When you order a drink in most local bars you will be served a small portion of food (or tapa) for free. This is the best way to try different local dishes for free while you visit the center of the city. Check some of the best places for tapas in this article of the Repsol Guide. If you want something more sophisticated, you can always book a table in Bagá, our Star Michelin restaurant which is within the top-5 restaurants in the world according to OAD.